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Abstract: In this text we consider discrete Laplace operators defined on lattices 
based on finitely-ramified self-similar sets, and their continuous analogous defined on 
the self-similar sets themselves. We are interested in the spectral properties of these 
operators. The basic example is the lattice based on the Sierpinski gasket. We in- 
troduce a new renormalization map which appears to be a rational map defined on a 
smooth projective variety (more precisely, this variety is isomorphic to a product of 
three types of Grassmannians: complex Grassmannians, Lagrangian Grassmannians, 
orthogonal Grassmannians). We relate some characteristics of the dynamics of its 
iterates with some characteristics of the spectrum of our operator. More specifically, 
we give an explicit formula for the density of states in terms of the Green current 
of the map, and we relate the indeterminacy points of the map with the so-called 
Neumann-Dirichlet eigenvalues which lead to eigenfunctions with compact support 
on the unbounded lattice. Depending on the asymptotic degree of the map we can 
prove drastically different spectral properties of the operators. Our formalism is valid 
for the general class of finitely ramified self-similar sets (i.e. for the class of pcf self- 
similar sets of Kigami, cf [25]). Hence, this work aims at a generalization and a 
better understanding of the initial work of the physicists Rammal and Toulouse on 
the Sierpinski gasket (cf [35], [34]). 

Resume: Dans ce texte, nous considcrons le Laplacien discret, dcfini sur un rcseau 
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construit a partir d'un ensemble auto-similaire finiment ramific, et son analogue con- 
tinu dcfini sur rcnscmble auto-similaire lui-mcme. Nous nous intcressons aux pro- 
prictcs spcetrales de ees operateurs. L'exemple le plus classique est celui du triangle 
de Sierpinski (Sierpinski gasket) et du reseau discret associc. Nous introduisons una 
nouvelle application de renormalisation qui se trouve ctre une application rationnelle 
definie sur une variete projective lisse (plus precisement, cette variete est un produit de 
Grassmaniennes de trois types: Grassmaniennes classiques, Grassmaniennes Lagrang- 
iennes, Grassmaniennes orthogonales). Nous relions certaines proprietes spectrales de 
ces operateurs avec la dynamique des iteres de cette application. En particulier, nous 
donnons une formule explicite de la densite d'etats en termes du courant de Green de 
I'application, et nous caracterisons le spectre de Neumann-Dirichlet (qui correspond 
aux fonctions propres a support compact sur I'ensemble infini) a I'aide des points 
d'indctermination de I'application. Suivant le degre asymptotique de I'application 
nous pouvons prouver que les proprietes spectrales de I'operateur sont trcs differentes. 
Notre formalisme s'applique a la classe des ensembles auto-similaires finiment ramifies 
(ou autrement dit a la classe des "pcf self-similar sets" de Kigami. cf [25]). Ainsi, 
ce travail generalise et donne une comprehension plus profonde des resulats obtenus 
initialement par Rammal et Toulouse dans le cas du triangle de Sierpinski (cf [35], 
[34]). 
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INTRODUCTION 



In this text we investigate the spectral properties of Laplace operators defined on 
hierarchical lattices based on finitely ramified self-similar sets, and their continuous 
analogs. The basic example is the lattice based on the Sicrpinski gasket. These 
operators have much to do with the operators considered in the context of Schrodinger 
operators with random or quasi-periodic potential. Here, the disorder is not in the 
potential but in the lattice itself. It is well-known that in the context of Schrodinger 
operators on the line the spectral properties are intimately related to the dynamics 
of the propagator of the underlying differential equation (cf, for example. [8]. [33]). 
In comparison, in our models we will show that the characteristics of the spectrum of 
our operator are related to the dynamics of the iterates of a certain renormalization 
map that we explicitly define and that appears to be a rational self-map of a compact 
complex manifold. 

The interest in such lattices and in their spectral properties comes from physicists 
(cf [35], [34], [1] and [4]) because they present interesting computable models, with 
peculiar properties. In [35], [34], on the particular lattice based on the Sicrpinski 
gasket, Rammal and Toulouse discovered interesting relations between the spectrum 
of the discrete Laplace operator and the dynamics of the iteration of some rational 
map on C. More precisely, they exhibited a polynomial map on C that relates the 
spectrum of the operator on successive scales: they remarked that if A is an eigenvalue 
at level n + 1 then A(5 — A) is an eigenvalue at level n. Traditionally, this law was 
called the spectral decimation of the Sicrpinski gasket, i.e. this terminology reflects 
the existence of a 1-dimensional map that relates the spectrum of the operator on 
successive scales. Starting from this, Rammal ([34]) gave a fairly complete description 
of the spectrum of the discrete operator on this lattice. In particular, he computed 
explicitly the eigenvalues and showed the existence of the so-called molecular states 
(that we call Neumann-Dirichlet eigenfunctions in this text) which are eigenfunctions 
with compact support. This was made rigorous and generalized to the continuous 
operator defined on the Sicrpinski gasket itself by Fukushima and Shima (cf [19]). 
The spectral type of the operator on the Sicrpinski lattice, has been analyzed by 
Teplyaev, cf [49]. 
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In general, the spectral decimation that works for the Sierpinski gasket is not valid, 
and the question of generalizing the initial work of Rammal remained unsolved. In 
[20] a class of lattices for which the spectral decimation works is exhibited. In [38], 
for the particular example of a Sturm-Liouville operator defined on M, the author 
made explicit some relations between the spectral properties of the operator and the 
properties of the dynamics of the iterates of a rational map; this map is no longer 
1-dimensional but is defined on the 2-dimensional projective space. 

This text aims at a generalization of these previous works. Besides the interest of 
the generalization, this brings new understanding of the models. In particular, the 
renormalization map involved is now multidimensional and certain notions which are 
specific to the dynamics in higher dimension and which were hidden in the case of the 
Sierpinski gasket (where the renormalization map involved was 1-dimensional), such 
as the notion of indeterminacy points (which corresponds to the singularities of the 
map), the degree of the iterates, enter the discussion and play an important role. In 
comparison with our previous work, [38], the main progress that allows us to handle 
the general case is the construction of a new renormalization map. This renormal- 
ization map is a rational map defined on some compact Kahler manifold. It is of the 
type of the maps considered in [13], [12], and our techniques rely heavily on recent 
works of Fornaess Sibony, Diller Favre, Guedj (cf [45], [16], [13], [12], [14]) on the 
dynamics of rational maps in higher dimensions. It is interesting to note that many 
of the key notions in this field (such as the degrees of the iterates, the indeterminacy 
points, the Green current) find a significance related to the spectral properties of our 
operators. In particular, we are able to give an explicit expression for the density of 
states in terms of the Green current of the map and we prove that the molecular states 
of Rammal (called Neumann-Dirichlet eigenvalues in the text) correspond exactly to 
the indeterminacy points of the map. 

Since the text is long, we first describe the model and our results on the par- 
ticular example of the lattice associated with the Sierpinski gasket. Let F C C, 
F = {0, 1, ^ -f i^}, be the vertices of a unit triangle, and ^fi, ^'2, vE's be the three 

homotheties with ratio ^ and centers the points 0, 1, ^ + i-^, repectively. It is well- 
known that there exists a unique proper subset X of C self-similar with respect to 
5*1, ^1/2, ^'3, i.e. such that X = U'^^i'^i{X), and that it is the celebrated Sierpinski 
gasket, represented on the following picture. 
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Fix now a sequence w G {1, 2, 3}^, called the blow-up, and define X<o> = X and 

It is clear that X<„> is an increasing sequence of sets and that X^n+i> is a scaled 
copy of X that contains X<„> as one of the three subcells; more precisely, we have 
X<„> = 'if'^ o ■ ■ ■ '^zl+ii'^^Tz+ii^))! which is clearly a subset of X<„+i>. Remark 
that the position of the cell X<p> in X<„> for n > p depends on the blow-up lu. We 
then set 

We define the boundary of X^n> by dX^o> = F and 

ax<„> = vi/-io...ovi/-_i(^^). 

There is a natural discrete sequence of lattices associated with this structure. The 
lattice at level is -F<o> = F, the vertices of the unit triangle in X<o>. The lattice 
at level n, is the set of vertices of the unit triangles in X<„>. More precisely, 

F<n> = • • • ° «'J!(U,,.. o . . . o vl/,„(F)). 

The position of i^<o> in the lattice at level n depends on to, and we represent on the 
following picture the lattice at level 4, F4. The bolded small triangle is the set -F<o> 
for the blow-up starting from {oji, . . . , UJ4) ~ (1, 1, 1, 1) on the left and (1, 3, 1, 2) on 
the right. The sequence is increasing and we set 

F<:oo> — U5^o^<n>i 

and 9F<„> = 9X<„>. 
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It is important to realize that the infinite lattices i^<oo> obtained from different 
blow-ups Lu and cu' are a priori not isomorphic (except when lu and uj' are equal 
after a certain level). To understand this, one can compare the constant blow-up 
(1, . . . , 1, . . .) with a non-stationary blow-up: the first one contains a point with only 
2 neighbors (which is the point 0, center of the homothetic ^i), on the second one 
all points have 4 neighbors (indeed, the boundary points dF^n> are sent to infinity 
when n goes to infinity). 

The aim of this text is to investigate the spectral properties of some natural Laplace 
operator defined either on the infinite lattice -F<oo> or on the unbounded set X<oo>- 
The class of lattices or self-similar sets we consider is issued from the class of finitely- 
ramified self-similar sets (also called p.c.f. self-similar sets in [25]) described in section 
1.1, and is much larger than the Sierpinski gasket. Although the classical examples 
have a natural geometrical embedding, these sets are defined abstractly from a very 
simple finite structure: one starts from a finite set F and one constructs i^<i> as the 
union of N copies of F, glued together according to a prescribed rule (represented by 
an equivalence relation 7?. on {1, ... , A^} x F), then F<2> is defined as the union of 
N copies of -F'<i> glued together according to the same rule, and so on. From this 
discrete structure, one can construct an increasing sequence of sets i^<„> , and also a 
self-similar set X (cf section 1.2 for precise definitions). 

To take into account the eventual symmetries of the picture, we fix a group of 
symmetries acting on each F<„> (but in general not on F<oo>)- For the Sierpinski 
gasket we can see that the group G ^ S3 {S3 denotes the group of permutation of F) 
of isometrics of the regular triangle 9F<„> leaves globally invariant the lattice F<ti> ■ 
We fix this group G as the group of symmetries of the structure (i.e. this means that 
we will only consider G- invariant objects). 

Note that for consistency with the notations of the main text, we denote by N the 
number of subccUs of -F<i>. Here, wc have = 3. 

We now define the type of operators we will consider in this text. We restrict to 
the discrete setting in this introduction and we present the definitions only in the 
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(2) H+^^fix)^^- ^^A<n>fix), V/eR^<">, VxGF< 



case of the Sierpinski gasket. On F<„> we define the difference operator A<„> as the 
operator on R^<"> defined by 

(1) A<n>f{x) = -J2ifiy)-fi^))^ V/eK^<">, 

where y ~ a; means that y is in the same triangle of unit size as x. The measure 
b<n> is defined as the measure which gives mass 1 to the points of dF^n> and mass 
2 to the points in i^<„> \ (?i^<„>. The choice of this particular operator and of this 
measure comes from the fact that they are self-similar in the sense that A<„> (resp. 
b<n>) is the sum of copies of the operator A<o> (resp. the measure 6<o>) on 
each of the small triangles of i^<n>)- 

The operators we will be interested in are the operators ff<„> defined on ]R^<"> by 

1 

It is clear that i?<„> is self-adjoint on L?[F^n> , ^<ri>) and semi-negative. The opera- 
tor with Dirichlet boundary condition on dF^n> , ^^<n> i is defined as the restriction to 
{/ e M^<"> , /|aF<„> = 0} of H^„>, and is self-adjoint on L'^{F^„> \ 9F<„>, 6<„>). 
The measure ^<n> and the operators Ff^^y naturally extend to a measure b^^y on 
F<:oo> and to semi-negative self-adjoint linear operators i?<oo> on i^(F<oo>, ^<oo>)- 
There are two measures which play a crucial role in this text. The first one is the 
classical density of states: for each n, denote by !^<„> the counting measures of the 
eigenvalues of -ff<„> . The density of states is defined as the limit 

n — »oo iV 

(In general, this measure exists and does not depend on the boundary condition.) 
The second measure is the measure that counts the asymptotic number of the so- 
called Neumann-Dirichlet eigenvalues: we say that a function is a Neumann-Dirichlet 
eigenfunction (or N-D eigenfunction for short) of i/<„> with eigenvalue A if it is both 
an eigenfunction of i?<„> and ^f<„> (with eigenvalue A), i.e. if it is an eigenfunction 
of ^f<„> null on dF^n>- These particular eigenfunctions play an important role since, 
when extended to F<oo> by 0, they arc eigenfunctions with compact support of the 
operators H^^y on the infinite lattice. One can define the counting measure of N-D 
eigenvalues i^^^y show that > Nv^^y. This implies that the limit 

^ n^oQ AT" <"> 

exists and is pure point. We call it the density of N-D eigenvalues. 

As we said before, the lattice F<oo> depends on the particular choice of the blow- 
up uj, hence the topological spectrum Y,^ of i?<oo> and the Lebesgue decomposition, 
EJ^, S^^, E^, of the spectrum of the operator on the infinite lattice -ff<oo> a priori 
depend on uj. By contrast, the measures /z and /i^^ do not depend on w (since the 
measures v%n> and v^n> obviously do not depend on uj). In [40], we proved basic 
results regarding the spectral properties of the operators -ff<oo> and, in particular, 
on their relations with the measures ^ and ji^^ . First we showed that the topological 
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spectrum and the Lebcsguc decomposition S]J^((jj), Y,f^{uj), '^^^{u!) of the op- 

erators H^^y{to) (we write ... to show the a priori dependence in the blow-up 

Lu) are constant almost surely in the blow-up uj, for the measure on {1, . . . , N}^ equal 
to the product of the uniform measure on {1, ... , TV}. Hence, we can talk about the 
almost sure spectrum and the almost sure Lebesgue decomposition of the spectrum 
of the operator i?<oo>- We also proved that the almost sure spectrum is equal to the 
support of the measure /i, i.e. that we have E*(a;) = supp(/x) for almost all blow-up 
Lo (actually, our result is more precise than this). Finally, we showed that when the 
density of states is completely created by the N-D eigenvalues, i.e. when = /z, 
then the spectrum of i?<oo> is pure point with compactly supported eigenfunctions, 
almost surely in lo. 

So, the measures /i and /i^^ give important information on the spectral properties 
of the operators H^^^. Hence, these two measures deserve to be understood and our 
aim in this text is to describe the relations that exist between these measures and the 
dynamics of a certain renormalization map that we construct. 

There are two renormalization maps, closely related, which play an important role. 
We do not define precisely these maps in this introduction, we just describe some 
of their properties. The first one, denoted by T, is defined on the space Sym*^, the 
space of G- invariant symmetric operators on C^, and is a rational map (i.e. TQ, 
for Q in Sym , is rational in the coefficients of Q). For example, in the case of the 
Sierpinski gasket Sym*^ C^: indeed, if Wq is the space of constant functions on F 
and Wi its orthogonal complement (for the natural scalar product on C^), then any 
element of Sym'' can be written thanks to 2 coordinates (mq, ui) G under the form 
uop^'iYg + MiPuvi where p\Wo ^^^'^ P\Wi ^-re the orthogonal projections respectively on 
Wq and Wi . We do not define explicitly the map T in this introduction (cf section 2 
and 3.1), but this map is easy to compute; for example, in the case of the Sierpinski 
gasket, in coordinates (uq, "i) we have T{uo, ui) = 3( ^"°"^^ , )■ This map is 

the one that was considered in earlier work of the author, [38]; it is also very closely 
related to the renormalization map that was introduced initially by Rammal and 
Toulouse in the case of the Sierpinski gasket. The iterates of this map contain some 
information on the spectrum of the operators on the n-th level lattice This 
explains why it was useful in the understanding of the spectral properties of these 
operators. 

Nevertheless, this map fails to give enough information. The main progress in this 
text is the construction of a new renormalization map defined on a bigger space: 
more precisely, it is defined on a projective space that contains Sym*^ as a smooth 
subvariety and it coincides with T on Sym*^. We consider two sets of variables (jj^)xeF 
and {rix)x£F, and the Grassman algebra generated by these variables (i.e. the algebra 
generated by ^x)xeF and {rjx)xeF: with the relation of anticommutation between 
all these variables). We denote by A the subalgebra generated by the monomials 
containing the same number of variables rj and rj. We also denote by 'P{A) the 
projective space associated with A and by tt : ^ ^ ^(-4) the canonical projection. 
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We set 

for any F x F matrix Q. Then there is a natural embedding of Sym*^ into VIA) given 
by 

Q 7r(exp 77Q77), 

where exp denotes the exponential of the Grassman algebra. Wc denote by L'-^ the 
closure in V{A) of Sym*^ (i.e. of the points of the type 7r(exp77Q?7)). We can show 
(cf section 2.2) that L'-^ is a smooth analytic subvariety of P{A) and it defines a 
compactification of Sym . For example, in the case of the Sierpinski gasket L*^ is 
equal to X (and indeed, x P^ is a compactification of C^). The key point in 
our work is the following: we construct a homogeneous polynomial map R : A ^ A 
of degree N. This map naturally induces a rational map on the projective space 
V^A): a fundamental property of this map is that it leaves invariant the subvariety 
]L,G ViA), and thus induces by restriction a map g : L*^. Actually, the map 

g coincides with T on the subset Sym*^ of L'^. More precisely, we have the following 
formula 

5 (tt (exp (77(577) )) = 7r(i?(cxp(?7Q77))), 
when both expressions arc well-defined. Hence, the restriction of the map g to L'^ 
extends T to the compactification L'^ of Sym''. The measures /i and /i^^ are related 
to the properties of the map R and and in particular, to the dynamics of the 
restriction of g to L*^. 

Let us now state our main results. We define the Green function of R (introduced 
by Fornaess and Sibony, cf [45] or appendix B) as the function G : A ^ M.LI {—00} 
given by 

G{x) = hm -Lln|li?"(a;)|l, Vx £ A 

The limit exists for all x in A and is a plurisubharmonic function (this essentially 
means that G is subharmonic when restricted to a complex line). This function G 
contains important information on the dynamics of the map induced by R on V{A). 
We denote by Pn{x), for x £ L*^, the order of vanishing of the restriction of the 
function i?" to L*^ (cf section 3.2). Since R is homogeneous of degree N, we have 
Pn+i{x) > N pn{x) and we set 

p^{x) = lim -^pri[x). 

We define : C — > ^ by (/)(A) = exp^(A<o> — AId)77. Theorem (3.1) gives the 
following explicit expressions for fx and p^^: 

(3) M=:5^AGo0, 

(4) m'^^ = ^Poo(0(A))<5a, 

A 

where A in (3) is the distributional Laplacian, and 5\ in (4) is the Dirac mass at A 
(Poo(0(A)) is null except on a countable set of A's, so that the sum (4) is well-defined). 
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In section 4, wc investigate the structure of the Green function on 7r^^(L'^). This 
is important since the Green function G\^-i(i^gj is related to the dynamics of the map 
g. On the other hand, we see from (3) and (4) that it is also related to the measures 
jj. and fi^^. The function G'|7r-i(LG) is the potential of a unique closed, positive, 
(1, l)-current on L*^: precisely, if s is a local section of the projection tt on an open 
subset U C the current ddPGos does not depend on s and defines a positive closed 
current on all L*^ (cf appendix, we recall that 

dd'G o s = -dd(G o s) = - y ^ ^ (G o s)dz, A dz,-, 

where the derivatives are taken in the sense of distributions). The current S is inti- 
mately related to the dynamics of the map g and to the structure of the measures /i 
and jjL^^ . With the iterates of g we can associate an asymptotic degree doo (called 
the dynamical degree, cf section 4.3) and we show in theorem (4.1) that the following 
dichotomy holds: 

— If doo < N , then 5 is a countable sum of currents of integration on hypersurfaces 
of L"^. In this case fj,^^ = n, thus the spectrum is pure point with compactly 
supported eigenfunctions, almost surely in oj. (We also show that the number 
of Neumann only eigenvalues, i.e. |i'<„> — !^<,(^|, grows like n'^°°). 

— If doo = N, then the current 5* does not charge hypersurfaces; it is the Green 
current of the map g. In particular, it is null on the Fatou set of g. Moreover, 
generically (in a sense made precise in theorem (4.1)), we have fi^^ = 0, i.e. 
there does not exist N-D eigenfunctions. 

Note that a similar dichotomy theorem was shown in [20] for the particular class of 
decimable fractals, for which there exists a 1-dimensional renormalization map that 
relate the spectrum on different scales (but the relation with the N-D spectrum was 
not made). 

Let us now make some remarks. The renormalization map we consider here is 
not the same as the one considered in our previous work [38]. The introduction of 
this new map is the key point that allows us to handle the case of lattices based on 
general finitely ramified self-similar sets. In particular, this map is not defined on a 
projective space. This induces several difficulties, for example, the notion of degree is 
more complicated and is related to the action of the map on some cohomology groups. 
But there are several facts that seem to indicate that the map we consider is the good 
renormalization map: the first one is that the indeterminacy points of g, which have 
a crucial influence on the dynamical properties of g, have a clear meaning in terms 
of the Neumann-Dirichlet eigenvalues of our operator. The second is that the map g 
behaves well in the non-degenerate case, i.e. when doo = N: to be more precise, the 
map g is algebraically stable (cf definition in appendix), and this allows us to define 
the Green current; this is not the case for other maps we could consider (cf section 
4.5 where we compare different renormalization maps) and which are birationally 
equivalent to g. Finally, let us mention that considering expressions like exp(^(5?/) 
in the Grassman algebra is very natural in the context of supersymmetry, and that 
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the theory of supcrsymmctry appeared to be very useful in the eontext of random 
Schrodinger operators (cf for example [28], [47]. [51]). 

The important question of determining the type of spectrum of the operator on the 
infinite lattice remains largely open: with our techniques we arc only able to character- 
ize a small part of the spectrum, namely the part of the spectrum which corresponds 
to compactly supported eigenfunctions (i.e. N-D eigenfunctions). It would be very 
interesting to determine the almost sure type of the spectrum of the operator (for 
example, to determine whether it is continuous or purely punctual) in terms of char- 
acteristic of the dynamics of the map (for example, in the spirit of Kotani's theorem 
where the Lyapounov exponent can characterize the type of the spectrum). There 
are very few examples where results in this direction are known: in the case of the 
Sierpinski gasket Teplyaev, cf [49], gave fairly complete results (depending on the 
blow-up); for a self-similar Sturm-Liouville operator on M we investigate the type of 
the spectrum for different blow-ups. cf [41]. Another interesting question would be 
to consider random potential on i^<oo> (or random fractal lattices as in [23]) and 
to determine whether Anderson localization occurs as for 1-dimensional Schrodinger 
operators. 

Let us now describe the organization of the paper. In the first part, we introduce the 
models and recall three elementary results obtained in [40] , concerning the spectrum 
and the density of states. In the second part, we give some preliminary results, 
which are crucial in the rest of the text. We introduce the Grassmann algebra and 
the Lagrangian Grassmanian. The third part is devoted to the proof of the main 
formulas (3) and (4). In the fourth part, we analyze the structure of the current S on 
L*^. Finally, in part 5 we illustrate our results by several examples. In appendix A. 
B, C, we recall some of the results from pluricomplexe analysis and rational dynamics 
that we need in the text. In appendix E, we describe the topological structure of 
G-Lagrangian Grassmanians. 

We treat both the lattice case and the case of operators defined on continuous 
self-similar sets. For a reader not familiar with the subject it is better, upon a first 
reading, to skip the discussion of the continuous case which is of a more technical 
nature. 

I am very grateful to Nessim Sibony and Charles Favre for many very helpful 
discussions. I also thank P. Bougerol for a useful reference and the referee for many 
valuable advices. 



CHAPITRE 1 
DEFINITIONS AND BASIC RESULTS 



1.1. Finitely ramified self-similar sets and associated lattices 

We introduce here an abstract definition of the notion of finitely ramified self- 
similar sets and of the associated lattices. Although all classical examples have a 
natural geometrical representation we choose to present the abstract setting since the 
procedure of construction is simple and natural. Let us describe it briefiy: first choose 
two integers TV and Nq, 1 < Nq < N. The basic cell is i^<o> = F = {I, . . . , Nq}. 
The set as level 1 is defined as the union of N copies of F, glued together according 
to a prescribed law TZ (formally defined as an equivalent relation on {1, ... , N} x F). 
In i^<i> we define the boundary set 9i^<i> as the set of points of the type {x,x) for 
X € F which can be identified with F (if TZ satisfies some minor properties) . Then 
we define the set at level 2, F<2>, as the union of N copies of -F<i> glued together 
by their boundary points, 9-F'<i>, according to the law 7?,, and so on. To define the 
infinite lattice we blow-up the structure, according to a sequence w in {1, . . . , N}^ , i.e. 
at each level, -F<„> is the sublattice tUn+i of F<„+i>. To construct the self-similar set 
we refine the structure instead of blowing it up. Let us now present precise definitions. 

1.1.1. The lattice case. — Let N and A^o be two positive integers such that 
1 < Nq < N. We set F = {1, . . . ,No}. The set F wiU represent the basic cell and 
N the number of cells at level 1. We suppose given an equivalence relation TZ on 
{!,..., N} X F (this equivalence relation will describe the connections in the set at 
level 1). For some reasons that will appear clearly later we assume that TZ satisfies 

— (i, x)TZ{i, y) implies x = y. 

— The class of (i, i) for i in F is a singleton. 

— For any (i, i') in {1, . . . , N} there exists a sequence ii = i, . . .ip ^ i' oi {1, . . . , N} 
such that for all fc < p — 1 there exists j and j' such that (ik, j)TZ{ik+iT j')- 

We first give the formal definition of the infinite set F<oo> and of its subsets F<n>- 
The lattice structure on these sets will be apparent only in section 1.2 and will be 
inherited from the discrete Laplace operator we construct on these sets. Let us fix 
an element ui ~ {uji, . . . , w^, . . .) in {!,..., called the blow-up. As explained in 
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the introduction, the blow-up uj describes how the sets -F<„> fit into one each other. 
Denote by F^oo the set of backward sequences (. . . , . . . , in {1, . . . , N}^ x 

F such that = LUk after a certain level. On -F<oo> we define the relation 7?,<oo> 
given by (. . . , . . . , j-i, a;)7?.<oo> (. . . , j^j,, . . . , jLi,x') if and only if there exists ko 
such that 

(5) j-k=j'-k^ forfc>fco + l, 

(6) = X, = x' , for fc > 1 and fc < fcp — 1, 

(7) and , a;)7^(j^fc^ , x'). 

Using the second property of 7?., we easily check that 7?.<oo> is an equivalence relation. 
Then we define -F'<oo> as the set -F'<oo> quotiented by 7?.<oo> • The increasing sequence 
of subsets F<o> C • • • C i^<n> C • • • C -F<oo> is defined by 

^<n> ={(••• , j-fc, • • • e i^<oo>, s.t. i^k = Wfc for all k > n}. 

(N.B.: in the last expression and in the following, we simply write (■ • ■ , j-k, ■ ■ • , j-i, x) 
for the class of (• • • ,j-k, ■ ■ ■ ,j-i,x) in ^<oo>)- It is clear that 

F<oo> = U^qF<„>. 

Denote by 7?.<„> the equivalence relation on {!,..., iV}" x F exactly as TZ, i.e. by 
(j_„, . . . , j_i,x)7?.<„>(jL„, . . .J'_i,x') iff there exists ko < n for which (5), (6), (7) 
are satisfied. In the definition of F^n> we see that only the terms (j-n, . . . ,j-i,x) 
count - the others are fixed to lu^ - and it is easy to see that F^n> can be identified 
with {!,..., A^}" X F/7^<„>. (More precisely, if F<„> is defined as the set of points 
(. . . , j-k, ■ ■ ■ ,x) such that = tUk for all k > n, then it is clear, thanks to the first 
property of TZ, that the natural bijection 8 : i^<„> {!,... , -/V}" x F, commutes 
with 7?.<oo> and 7^<„>, i.e. that XTZ<^oo>Y iff 9(X)7^<„>9(y). Hence, F^n> can 
be identified with {!,..., TV}" x F/7^<„>.) For example, the set i^<o> is equal to F 
and the set F<i> is equal to {1, . . . , N} x F/TZ. The boundary of the set F<„> is 
defined as 

dF^n> = {{x, ...,x)£ F<„>, for some x in F {1, . . . , Nq}}. 

Thanks to the second property of TZ, we see that dF^n> can be identified with F 
(i.e. the map a; G F ^ (x, . . . , x) G dF^n> is bijective). The boundary set 9-F<oo> is 
defined as 

dF^ao> = nj^o Um>n dF^rn> 

= {(. . -J-k, ■ ■ ■,j-i-,x) e F<oo> s.t. i^k = X for aU k > 0}. 

We set F<n> = ^'<«> \ 9i^<«> and F<oo> = i^<oo> \ 9F<oo>. 

Remark 1.1 : By definition (?F<oc> 7^ if and only if ujk is stationary to a cer- 
tain X in F: in this case dF^ao> contains the unique point {. . . , x, . . . , x). 
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For all n, p and {ii, . . . , ip} in {1, ... , N}p we set 

P'<n+p>,ii,...,ip 

= {{j-{n+p)T ■ ■ ■ J j-lj & F<n+p>, S.t. j_(„+p) — ii, . . . , j_(^n+l) — ip}- 

It is clear that 

^<n> F<n+p>,uj„^p,...,Un^i 

and that 

p I I AT p 

^ <n+p> — = <n+p>,ii,...,ip- 

In this sense, F^n+p> is the (non-disjoint) union of copies of F<n> . The subsets 
P<n+p>,ii,...,ip are called the < n >-cells of F<„+p>. It is clear that the < n >-cells 
can only intersect by their boundary sets dF^n+p>,ii ip (with the obvious definition 

9i^<„+p>,ii,...,,;p = {{ii, . . . ,ip,x, . . . ,x) e F<„+p>, for x G F}). 

Remark 1.2 : At this point we did not construct any lattice structure: the lat- 
tice structure will be induced by the discrete Laplace operator we shall construct on 
F<:n> and -F<oo> (in fact, as we shall see, two points will be neighbors for this oper- 
ator if they belong to the same < >-cell). 

To take into account the eventual symmetries of the structure we suppose given 
a finite group G (eventually trivial) acting on {1, . . . , N} and leaving invariant the 
subset F=:{l,...,A'o}. We suppose that the relation TZ is G-invariant, for the action 
of G on the product {1, . . . , A^} x F. The relation ??,<„> is then clearly G-invariant for 
the action of G on {1, ... , TV}" x F. Thus, the group G acts on the quotient F^n>, 
leaving globally invariant its boundary set dF^n> (remark that if we consider the 
action of G on i^<„_|_i> then it does not leave the subset i^<n> invariant in general. 
For this reason there is no natural action of G on the lattice i^<oo>)- This symmetry 
group will play the following role: all the objects we will consider will be G-invariant, 
in particular the discrete Laplace operator wc will construct on i^<„>. 



1.1.2. The continuous (or fractal) case. — It is easy to construct a self-similar 
set from the previous discrete structure. The definition we introduce here is a bit less 
general than the classical definition of p.c.f. self-similar sets introduced by Kigami 
(cf [25]), but a bit more constructive. Formally, we define X as the set {!,..., N}^ 
quotiented by the equivalence relation given by: (ji, . . . . . .) ^ (ji, ■ • ■ , jj,, ■ • ■) 

if and only if there exists an integer fco and two elements x and a;' in i<" = {1, . . . , A^o} 
such that 

(jli ■ • ■ I jfeo-l) = (ill • ■ • ; Jfeo-l)' 

jk = X and j[, = x' for all A: > fco + 1, 
and (jfco,a;)7^(JX^,a;'). 

If we equip {1, . . . , A^}^ with the usual metric d given by d{{jk), (j^)) = ~hlt{T7^77T' 
then X is compact for the quotient topology (and mctrizablc) . It is also easy to check 
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that the third property of TZ implies that X is connected. The boundary set of X is 
define as the set 

dX = {{x, . . . ,x, . . .), for a x in F}. 
It is clear that dX can be identified with F thanks to the second hypothesis on TZ (so 
we usually write dX = F). We denote by '1'.; : X ^ X the application 

. . . ,Z„, . . .)) = («,«!, • . -,1,1, ■ ■ ■)■ 

Thanks to the first hypothesis on TZ, each 5'^ is injective. We see that 

x^ul,^,{x), 
^^{x) n = ■^..iF) n ^^{F), yi ^ j. 

Hence the set X is self-similar with respect to the injections ^'i. Prom the second 
relation we see that the connections between the subsets ^'i(X) of X are contained 
in the image of F by the application ^f^: this justifies that we consider F as the 
boundary of the set X. We now construct an infinite sequence of sets X<o> C • • • C 
X<„> C • • • C X<oo> as in the discrete case. Remind that we fixed w in {1, . . . , N}'^ 
called the blow-up. We set: 

^<oo> = {{jk) G {1, ■ • ■ , N} , s.t. there exists fco > s.t. j-k = i^k for all k > ko}. 

Then we define X^oo> as the quotient of X<oo> by the equivalence relation ^<oo> 
defined exactly as ^, i.e. by: [jk)k& ^<oo> {jk)kei, if and only if there exists fco G Z 
and two elements x and x' in F 

jk = j'k for all fc < fco - 1, 
jk = X and j'f. = x' for all fc > fco + 1, 
and (jfco,x)7^(JXo,a;')• 

Then we set for all n > 

X<n> = {{jk) e X<oo>, s.t. j-k = iOk for all fc > n}. 
It is clear that for X<„> only the terms (j-n, . . .) counts, thus the set X^n> can be 
considered as the set {1, . . . , TV}'""'""-* quotiented by the equivalent relation induced 
by ~<oo> (and in the following we will represent the points in X<„> only by the 
sequence (j_„,...)). It is then clear that X<o> — X (actually all X<„> can be 
identified with X, just by shifting the indices), and that 

As in the discrete case we set 

X<_n+p>.ii,...,ip 

= {{ik)'tL-(n+p) ^ X^n+p>, S.t. (j_(„+p), . . . , j_(„+i)) = (ii, . . . ,ip) }. 

It is clear that 

X<:n> — ^<n+p>,i^„-|-p,...,ij„ + i 

and that the set X^n+p> is the non-disjoint union 
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The boundary of X<„>, is defined by 

dX^n> = {{x, . . . ,x, . . .), for a x in F}. 

o 

We set X<ri> = X^n> \ 9X<„>. Finally we set 

= {(jfc) e X^oc>, s.t. jk = X for some x in F}, 

o 

and X<oo> ~ ^<oo> \ 5X<oo>. 

Remark 1.3 : The set X<„> (resp. X<oo>) contains the discrete set F<„> (resp. 
F<oo>) as the set of sequences {jk) such that jfc = a; for a x in and all fc > 0. With 
this identification we clearly have dX^n> = dF^n> and dX^ao> = dF^cc>- 

1.1.3. Geometric embedding. — All classical examples come from self-similar sets 
which have a natural embedding in K''. We now describe how such a structure appears 
in geometrical examples of self-similar sets. It is essentially related to the property 
of finite ramification. Suppose given ^'i, . . . , N strictly contractive similitude of 
with different fixed points Xi, . . . , xn- It is well-known that there exists a unique 
proper subset X of such that 

(8) X = uiIi*,(X). 

The set X is compact and actually equal to the set of limits lim„^oo o • • • o (y) 
for (ifc) G {1, ■ • ■ ,N} . It is easy to see that the former limit does not depend on 
y, so that it defines a mapping from {1, . . . , N} onto X. Hence, X can be written 
{1, . . . , A^}^/ ^ for a certain equivalence relation ~. We can easily check that ~ can 
be constructed as previously if the set X is connected and if there exists a subset F 
of the set of fixed points of 5*1, . . . , ^Pjv such that 

(9) ^,ix)n^,ix)^^,{F)n^jiF), yt^j. 

(This last condition is usually called the condition of finite ramification.) Indeed we 
can as well suppose that F = {xi, . . . ,xno} for iVo = |F| < iV and identify F with 
{!,..., No}. We define the relation 7^ on {1, . . . , iV} x F by {i, j)n{i' , f) if and only 
if 'i/i{xj) = 'i>ii{xji). It is then easy to see that the relation ~ we just defined is also 
the relation obtained as in section 1.1.2 from the relation TZ. 
In this case the sequences X<„> and F<n> are naturally embedded in as 

F<n> ° *J!(U,,,. O . . . O vl/,„(F)). 

The sets dF^n> and 9A<„> are just scaled copies of F, given by 
5F<„> - dX<n> = *J> • • • o *ji(F). 
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1.1.4. Examples. 

In this case Nq ~ N 
picture: 



The Sierpinski gasket 

3; F = {1,2,3} and the relation TZ is given on the foUowing 





(1.2) 7^(2,l) 

(2.3) 7^(3,2) 
(3,l)7^(l,3) 



F ■^<i> 
The set at level 4 is represented on figure 2 in the introduction: the initial cell F<o> 
is represented by the bolded triangle for the blow-up starting from (1, 1, 1, 1) on the 
left and for the blow-up starting from (1, 3, 1, 2) on the right. Usually we take for G 
the group of permutations of F = {1, 2, 3} (i.e. geometrically, G acts on F<„> as the 
group of isometrics of the boundary triangle dF^n>)- But we could also consider the 
trivial group as the group of symmetries (this is considered in section 6). 
As it is well-known, the Sierpinski gasket is traditionally considered as a self-similar 
subset of C. Let us now describe this and the relations with the discrete structure we 
just introduced. Consider the 3 homotheties 

*i(a;) = |; *2(a:) = i(.T-l) + l; 

vl.3(^) = i(^_(i+^^)) + i+^^. 
' 2^ 4 2 2 2 

There exists a unique proper subset of C that satisfies equation (8) and it is the 
celebrated Sierpinski gasket represented on picture 1 of the introduction. Remark that 
the set of fixed points F — {0, 1, | + of 5*1, ^'2, ^'3 satisfies (9) and defines the 
relation 7?. as explained in section 1.1.3 by if and only if (xj ) = 'i'i'{xj') 

(if we denote by Xi,X2,X3 the fixed points of \l/2, Vl/s). The natural geometric 
representation of X^n> is given by the sequence of preimages 



X<n> = ^Z! ° 



The set -F'<„> is the set of vertices of the triangles of size 1 in 
The unit interval 

Let us first describe the continuous model, by its geometric representation. Consider 
X = [0,1] and a real < a < 1. It is clear that X is self-similar with respect to 
the N ^ 2 homotheties ^'1(2;) = ax and ^'2(0;) = 1 -I- (a; — 1)(1 — a). Remark that 
F — {0,1} satisfies equation (9): the abstract self-similar set would be constructed 
from the equivalence relation TZ such that (1, 2)7?,(2, 1). (Remark that when a = 
the abstract definition of the self-similar set [0, 1] as a quotient of {1, 2}^ corresponds 
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exactly to the expression of a point in [0, 1] in base 2). Wc take for G the trivial group 
G = {Id}. We remark that for different values of a we just have different geometric 
representations of the same self-similar structure as defined in 1.1.2. We will consider 
on these sets different operators depending on a, which have a natural expression in 
these geometric representations. Concerning the blow-up we remark that dX^ao> is 
non empty if and only if uj is stationary. More precisely, if w is stationary to 1 (resp. 
to 2) then X^oo> is a half-line bounded from the left (resp. from the right) (for 
example, if ijj„ = 1 then X<,i> = [0, a^"])- If is not stationary then X^oo> = K. 
The nested fractals 

The nested fractals define a class of finitely ramified self-similar sets, introduced 
by Lindstrom (cf [31]), embedded in W^, which are invariant by a large group of 
symmetries. We refer to [31] for the definitions. Note that the Sierpinski gasket is 
the basic example of nested fractals. 



1.2. Construction of a self-similar Laplacian. 

We fix for the rest of the text two A^-tuples (ai, . . . , ajv) and (/3i, . . . , Pn) of pos- 
itive real numbers. The iV-tuple (ai, . . . , ctAr), resp. . . . , /3n) will represent the 
scaling in energy, resp. in measure in our structure. We suppose moreover that 
(ai, . . . , aAf), (/?!, . . . , /3jv) are G-invariant, i.e. that {ag-i, • • • , ag.^) = {ai, ■ • ■ , cin), 
{Pg.i,--- ,f3g.N) = iPi, ■ ■ ■ , Pn)- We set -fi = {aif3i)^^ and we make the following 
assumption 

(H) We suppose that (/3i, . . . , Pn) is proportional to {a^^ , . . . , a^^) so that 7i does 
not depend on i. We denote by 7 the common value of the "fi. 

1.2.1. Discrete difference operators. — We suppose given A, a semi-positive 
symmetric endomorphism of M.^ of the form 



where ax,y, x y^y, are non negative reals such that a^^y = ay^x- We suppose moreover 
that A is irreducible, i.e. that the graph on F defined by strictly positive ax,y is con- 
nected and that A is G-invariant, i.e. that Ug.x^g.y ~ ax,y for all g in G. We suppose 
also given a G-invariant positive measure b on F. 

Remark 1.4 : A typical example is the discrete Laplace operator Af{x) = — J2y^xifiy)~ 
f{x)) and b the uniform measure on F. 

We denote by A^n>,ii,...,i„ the symmetric operator on R^<"> defined as the copy 
of A on the cell -F'<n>,ii,...,i„, i-e. the operator defined for / in R^<"> by 



(10) 



Af{x) 




<n>,ii,.. 
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N.B.: In the first line wc considered /|^^^^ . as a function on since i^<„>.ij^..._i„ 
can be identified witli F. 

We denote by b<^n>,ii,...,in the measure on F^n> defined as the copy of b on F^n>,ii,...,i„ , 
i.e. given by 

/ M<„>.i....,,„ = //|F<„>,, ,Jb, V/eR^<">. 

Then we set 

N 

(11) A<„> = ^ auj„ ■ ■ ■ a^j^a^^^ ■ ■ ■ a:[J^A<n>,ii 

=1 



N 

(12) 6<n>= J2 PZl■■■PZlP^^■■■P^Mn>,n,...,^^■ 

Remark 1.5 : We see from the definition that the vahie of A<„> and depend 
on the A^-tuples (ai, . . . , a at) and (/3i, . . . , (3n) only up to a constant. 

Remark that j4<„> and &<n> form an inductive sequence since, for n > p, if supp(/) C 
F<p> U (5F<p> n 9i^<„>) then 



^<n>/ = ^<p>/ and J fdb^n> J fdb^py. 

(Indeed, this comes from the fact that F<p> = -F<n>.w„....,a;p+i)- Therefore 6<„> 
can be extended to a measure 6<oo> on -F<oo>. Similarly, the linear operators j4<„> 
can be extended to a linear operator j4<oo> on R^<°=> (a priori A<oo> is defined on 
compactly supported functions of -F<oo>, but since there is only "local interactions", 
^<oo> can be extended to a linear operator on R^<°°> itself). Remark that thanks 
to the third property of TZ the operator A<„> is conservative, i.e. A<„>/ = is 
equivalent to / constant. 

Denote by < •, • > the usual scalar product on M^<">. Let i^<„> be the operator 
on L'^{F^n>,b^n>) defined by: 



(13) <A^^^f,g>=-jH+^^fgdb, 



V./,.ge 



The operator i?<„> is semi-negative, self-adjoint and must be viewed as a discrete 
difference operator with Neumann boundary condition on dF^n> (since no condition 
is imposed on the value of the functions on the boundary points). The operator with 

o 

Dirichlet boundary condition, denoted is the self-adjoint operator on R^<"> 

defined as the restriction of i7^„> to R^<"> ~ {/ S R^<">, /|aF<„> = 0}. We 

o 

sometimes write f^^^ = R^<"> and 2?<„> = R^<"> for the domain of 

If it" > is such that < AfJ >< K J pdb for aU / in R^ then it is easy 
to see from (11) and (12) and assumption (H) that the same inequality is true for 
^<n> and &<„>. Thus the sequence iy<„> is uniformly bounded for the operator 
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norm on L'^(6<„>) and can be extended into a semi-negative, self-adjoint operator 
f^<oo> on ^<oo> ~ L^{b<oo>)- We define i?<oo> as the restriction of i?<oo> to 
2'<oo> = {/ e 2?<oo>> /|aF<^> = 0}. Clearly, we have 

< A<^ao>f,9 >= - j i/<oo>/5d&<oo>, yf,g<^'D<oo>- 

Finally note that if dF^oo> = then the operators i?<oo> and H^r^y are equal and 
in this case we simply write i?<oo> for ^<oo> ^ H<oo>- 

Let us now explain the consequences of condition (H). Let / be a function with 

o 

support contained in F<n>- Denote by / the function on -F<oo> with support in 
F<n+p>,ii....,i and which is a copy of / on F^n+p>Ai,....i ■ Then from formula (11), 
(12) and (13) we see that 

(14) (^<oo>/)|F<„+p>,,i,...,.^ = 7c^„+i • • • 7i^„+p(7ii • • •7»p)"^(^<oo>/)|F<„> 

and that i^<oo>/ is null on the complement of F<„+p> ij^. ^ ij^. By (H) the coefficients 
7^1 ■ ■ ■ 7uj„ (7ii ■ ■ ■ 7ip )~^ are equal to 1, which means that i?<oo> is locally invariant by 
translation. This property is the counterpart of the property of statistical translation 
invariance traditionally assumed in the case of Schrodinger operator with random 
potential. 

1.2.2. The continuous situation. — In this section we define a "natural" Laplace 
operator on the continuous sets The problem of the construction of such an 

operator is not easy (cf for example, [31], [25], [30], [36]) and it is now clear that the 
best framework to use is the framework of Dirichlet spaces. We essentially follow the 
definitions of [36]. We suppose here that J2iLi A = 1 and that < 1 for all i. We 
know that there exists a unique probability measure m on X such that 

TV 



(15) / /dm = / / 

Jx - , Jx 



We suppose given a G-invariant self-similar Dirichlet form (a, I?) in the sense of [36], 
i.e. an irreducible, local, conservative, regular Dirichlet form on {X, m) satisfying the 
conditions of theorem 2.6. of [36]. In particular, (a,!?) is self-similar with respect to 
the weights (ai, . . . , ajv), i-C for all / e P, / o '^^ is in V and 



N 



(16) a(/, /) = y{a,)-^a{f o vj/,, / o vj;^) 



1 



and is G-invariant, i.e. a(g ■ f,g ■ f) = a,{f,f). In [36], a criterion is given for 
the existence and uniqueness of such a Dirichlet form. Remark that the weights 
(ai , . . . , QfAr) can be chosen only up to a constant, since the scaling factor is determined 
by equation (16). The problem of the existence and uniqueness of such a Dirichlet 
form is not trivial and has been investigated in [31], [36] (and references therein). 
This is related to the existence of a fixed point for a certain renormalization map 
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(that corresponds to the restriction of the rcnormahzation map T that we introduce 
in section 3 to a certain subset, cf remark 3.4). 

Remind that X<„> is isomorphic to X so that we can define the Dirichlet form 
{o-<n>,T^<n>) by X'<„> ~ V and a<„> = oi^ji ■ ■ ■ oiuj^a and the measure 6<„> on 

o 

X<n> by 5<„> = ■ ■ ■ I^Zl^- If / in V^^+py is such that supp(/) C X <n> 
then using (15) and (16) we see that a^n+p>{L f) «<«>(/,/) and / fdm^ny = 
J fdm^n+p>- Hence, we see that m^n> can be extended to a measure m<oo> on 
^<oo>i and we set 

2?<oc» = {/ e i^(^<oo>,"i<oo>), supa<„>(/|x<„>,/|x<„>) < oo}. 

n 

On P<oo> we define a<oo> by a<oo> (/, /) =^ liniyi_,oo CL<n> (/|x<„>,/|x<„>)- One can 
check that a<oo> is a local, regular, conservative and irreducible Dirichlet form (cf 
[18]). We set X'<„> = {/ e X'<,i>, /|ax<„> = 0} and = 2?<n> (and idem for 

^<oo>)- We define -ff<„> and -ff<oo> as the infinitesimal generators of (a<n>, 2^<n>) 
and (a<oo>j2?^o2>). Note that they satisfy the same property of local invariance by 
translation as in the discrete case, i.e. formula (14) is still valid. 

1.2.3. Examples. — The Sierpinski gasket 

If we take G ~ 5*3 the group of isometries of the unit triangle F, then the values of 
(tti) and {(3i) are determined up to a constant, so we can as well take in the lattice 
case ai = 1, Pi = 1. There is only one possible choice for A and b, up to a constant: 
we take for A the canonical discrete Laplace operator on F given by formula (10) 
with ttx^y = 1 a X y, and for b the measure that gives a mass 1 to the points of F. 
The operator A<„> is obviously given by formula (1) of the introduction and f'<„> is 

o 

the measure that gives a mass 1 to the points of dF^n> and 2 to the points of F<n>- 

Hence, the operator i?<„> is the operator defined by (2) in the introduction. 

In the continuous case the construction of the Laplace operator was initially done in 

[2] by probabilistic means. There is uniqueness of such an operator. The value of (a^) 

and (/Sj) is determined by equation (15) and (16) to ai = |, /3i = i (cf for example, 

[30]). 

The unit interval 

In the lattice case we can take any and (3i but since they matter only up to a 
constant we take ai = a, a2 = (1 — a) and Pi = I — a, P2 = ct (hence, assumption 
(H) is satisfied). In the lattice case the only possible choice for A is, up to a constant, 
the discrete Laplace operator 



A = 



1 -1 
-1 1 



The measure b is determined by two positive reals mo, mi by 6 = moSo + mi6i. 

In the continuous case we can explicitly construct the self-similar structure. Let 
m be the unique self-similar measure on X satisfying (15). Consider on [0, 1] the 
canonical Dirichlet form a{f,f) = j^{f'Ydx defined on = L'^{m), f G 

L^([0, l],c?a;)}. By a simple change of variables it is clear that a satisfies (16) with 
ai ~ a and a2 ~ I — a. Hence we have explicitly constructed the self-similar Dirichlet 
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space (a,I?), for all possible values of a. The operator iJ+ — i?<o> operator 
-L-k defined on 

{/eL2(X,m), 3gGL2(X,m),/(a;) = aa; + fe+ g{z)dm{z)dy, 

/'(0) = /'(l) = 0}, 

by F+/ = .g. 

Similarly i/^ is the operator with Dirichlct boundary condition on {0, 1}. The 

author considered this case in [38] and [41]. 

The nested fractals 

In general, for nested fractals we take all the equal, and the f3i equal (in the 
continuous case the exact value of the ai is given by the self-similar structure and the 
Pi must be equal to -^). There is nothing special to say about the lattice case. In the 
continuous case, Lindstrom and Kusuoka constructed the self-similar Dirichlet space 
(cf [31], [30]) and the author proved the uniqueness of such a self-similar Dirichlet 
space (cf [36]). 



1.3. The density of states 

1.3.1. Definition. — The lattice case 

Denote by = A+„> i > A+„> 2 > ••• > ^tn>,|F<„>| eigenvalues of i?^„>. 
Denote by > ^^n>,i > ■ ' ' > A^ „ the Dirichlet eigenvalues, i.e. the eigen- 



<n>,|F<„>| 



values of H^^y. 



Let u+ 

n> (resp. v^n>) be the counting measures of the Neumann (resp. Dirichlet 
spectrum) defined by: 

(17) ^<n>=E'^A±„,,. 

k 

where 5x stands for the Dirae mass at x. We write J^<„> (A) = />^„>(dA), A < 0, 
for its repartition function. 

It is clear by construction that the counting measures do not depend on the blow-up 
Lo (since the operators i?<„> are isomorphic for different blow-up lo). 

Definition 1.1. — If the limit 

(18) 1™ -^^<n> 

exists and does not depend on the choice of the boundary condition then it is called 
the density of states and denoted by /i. 

Remark 1.6 The existence of the limit is proved in [18] and in [27] but will also be 
a consequence of theorem (3.1). 

Remark 1.7 : The reader must be careful that our terminology is not coherent with 
the classical terminology of [8] , [33] and with the terminology of our previous paper 
[38] where the measure ^ is called the integrated density of states. Remark that 
despite the terminology, is a measure which may have no density. 
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The continuous case 

In this case the operator i?<„> has compact resolvent (cf for example, [30]) and 
the eigenvalues form a non- increasing sequence going to — oo. 

We adopt the same definition for the counting measures i^<„> and for the density of 
states as in the lattice case. 



Proposition 1.1. — If the density of states exists then its repartition function ^(X) 
l-i{X){dX) satisfies: 

(19) fi{jX)=Nfi{X). 



Proof: This is clear from the scaling relations satisfied by a<„> and m^n>- D 

1.3.2. The density of Neumann-Dirichlet eigenvalues. — We say that a func- 
tion f is a Neumann-Dirichlet (N-D for short) eigenfunction of i?<n> with eigenvalue 
A if it is both a Dirichlct and a Neumann eigenfunction (therefore we forget the sup- 
script ± in i/<n> since it is at the same time an eigenfunction of -ff<„> and i?<„>), 
i.e. in the lattice case this means that 

- / is in i.e. / € R^<"> and /|aF<„> = 0, 

- < ^<n>/,5 >= -A / /5d6<„>, for aU function g in X'+„> = R^<->. 
and in the continuous case that 

- / is in !?<„>, 

- a<n>{f,g) = -A/ /5dm<„>, for all function g in !?<„>. 

We denote by v^n> the counting measure of the N-D eigenvalues of H^n> (counted 
with multiplicity) and by E^^y the subspace of generated by the N-D eigen- 

functions. 

Remark that any function / of E^^^, when extended by to F^n+p> (resp. 
X<„+p>) is a N-D eigenfunction of H^n+p>- When extended by to F<oo> (resp. 
X<oo>) it is an eigenfunction of H^r^iy and -ff<oo>i with compact support. Hence 
E^J^i, is an increasing sequence of subspaces of I?<oo> ^'iid we denote hy Hnd the 
closure in V^^y of the space UnE^^y- 

Remark 1.8 : By definition, the restriction of -ff<oo> to the Hilbert subspace H-nd 
is purely punctual, more precisely, the set of Neumann-Dirichlet eigenfunctions form 
a Hilbert basis of compactly supported eigenfunctions. 



It is easy to see that 



'^<n+l> — ^^'^<n>- 



Indeed, if / is a N-D eigenfunction of i7<„> then we can construct copies of / on the 
N < n >-cells of F<„+i>. Precisely, for alH = 1, . . . , TV we consider the function fi 
on R-^<"+i> which is the copy of / on F^n+i>,i and equal to on F<„+i> \ F^n+i>A- 
These functions form an orthogonal family of N-D eigenfunctions of H^n+i> with 
same eigenvalues (by the hypothesis (H) and formula (14)). 
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Definition 1.2. — The limit 



ND 



exists and is called the density of N-D eigenvalues and denoted by /i 

Remark 1.9 : Obviously, the measure /i^^ is purely punctual. It is clear that 
supp/i^^ is the topological spectrum of the restriction of ^^<oo> to the Hilbert sub- 
space Hnd- 

Remark 1.10 : In the continuous case the repartition function ^^^(A) — dfi^^ , 
A < 0, satisfies the same scaling relation as /^(A): ij,^^{'jX) = Nfi'^^{X). 



1.4. Some basic results 

We recall from [40] three basic results on the spectrum of the operators i?<oo> 
and their relations with the measures fi and ji^^ . For convenience, we suppose 
here the existence of the density of states. We denote by the spectrum of the 
operators i?<oo> (and we simply write S when dF^aa> ~ 0)- We recall that the 
essential spectrum is obtained from the spectrum by removing all isolated points 
corresponding to eigenvalues with finite multiplicity, we denote it by S . 

Proposition 1.2. — (proposition 1, [40]j 

For both the lattice and the continuous case we have the following: 

i) If the boundary set dX^oc> = (?^<oo> is empty then supp^ = E = Ti^ss- 

ii) Otherwise we just have supp^ = S^^g = Sg^g. Moreover, the eigenvalues 
eventually lying in \ supp{i^i) have multiplicity 1. 

Remark 1.11 : In [41], we show that in the case of the unit interval blown-up to 
the half-line (by the constant blow-up oj^ — 1) the spectrum of the operator can 
be pure point with isolated eigenvalues of multiplicity 1 lying in the complement of 
supp/i and accumulating on supp/i. Therefore in this case the equality S^ss ~ supp/i 
is satisfied by not supp/i. 

We endow fl = {1, . . . , N}^ with the product of the uniform measure on {1, ... , N}. 
The next two propositions give almost sure results on the blow-up. Remind that the 
lattices i^<oo> (and the sets X^oo>) are not isomorphic for different blow-ups. Hence, 
to show the dependence of the operator -ff<oo> and of the spectrum on the blow- 
up we write H^^^lcu) and I]='=(w). We denote by Ejj,(w), T,f^{iLj), and Epp(a;) resp. 
the absolutely continuous, singular continuous and pure point part of the Lebesgue 
decomposition of the spectrum of iJ^^>(w) (cf [8], [33] for definition, or [40]). The 
first result is the analogous of a classical result for ergodic families of Schrodinger 
operators (cf [8] or [33]). 

Proposition 1.3. — (proposition 2, [40] j 

There exists deterministic S, '^ao '^sc, T,pp such that for almost all io in Q (for 
the product of the uniform measure on {1, ... , N} ) we have Y,^ (uj) = E. . 
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Proposition 1.4- — (proposition 3, [40] j 

If the density of states is completely created by the N-D eigenvalues, i.e. if 
then for almost all uj in the set of N-D eigenf unctions is complete i.e. TLnd — 
^<oo>('^) = ^<oo>(^)- Thus, the spectrum is pure point with compactly supported 
eigenf unctions. 



CHAPITRE 2 



PRELIMINARIES. 



2.1. The notion of trace on a subset 

Let F be a finite set and F' C F a subset. 

Definition 2.1. — Let Q be a complex symmetric F x F matrix. We denote by Q\f' 
the restriction of Q to F' , i.e. the F' x F' matrix defined by {Q\F')x.y = Qx,y for x,y 
in F' . We call trace on F' of the matrix Q, the F' x F' matrix Qf' , given, when the 
expression is defined, by 



different types of restriction. 

N.B.: These definitions could of course be given for non symmetric matrices but we 
will only be concerned with the symmetric case. 

Remark 2.1 : Qf' is sometimes called the Schur complement and appears in several 
circumstances, cf for example, [32], [7]. In [9] the properties of this operation are 
carefully investigated, this operation is called "la reponse du reseau". 

Proposition 2.1. — i) If Q has the following block decomposition on F' and F\F' 



Therefore the map Q ^ Qf' is rational in the coefficients of Q with poles included in 
the set det{Q^F\F') ~ 0. 





then 



(20) 



Qf' 



Q\F'-B{Q\F\F'r^BK 




we denote by Hf, the 
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We call Hf the harmonic prolongation of f with respect to Q and we have Qp'if) = 
Hi) If moreover Q is real semi-positive then Qp' is characterized by 

(21) <Qf'/,/>= inf <Qg,g>, V/eR^', 

where < •, • > denotes the usual scalar product resp. on MF and . The infimum 
is reached at the unique point H f . 

Remark 2.2 : The terminology comes from the theory of Dirichlct forms: if Q is 
semi-positive and such that < Q-, • > is a Dirichlct form (i.e. Q is Markovian, cf for 
example, [36]) then < Qf'-,- > is a Dirichlct form called the trace of < Q-,- > on 
F' (cf [17]). In particular, we remark that the Markov property is preserved by the 
operation of taking the trace. 

Proof: i) Let / be a function in null on F C F' . Set g = Q^^f- We easily get 

9\F\F' = -{Q\F\F')^^ B*- g\F' 1 

and 

f\F' = Q\F'9\F' + Q\F\F'9\F\F' 

= {Q\F' ~ B{Q\F\F')''^B*)9\F' ■ 

By definition {{Q^'^)\f' f\F') = 9\f'- This implies that f\F' — Qf'{,9\f') thus 
formula (20). 

ii) It is an immediate consequence of i). 

iii) Classically, g realizes the infimum in (21) if and only if {Qg)\F\F' 

= 0, i.e. if 

B* f + Q\F\F'9\F\F' = 0. If Q|F\_F' is invertible then g is unique and given on F \ F' 
by 9\F\F' — ~'{Q\F\F')~'^ B* f . This implies that g = Hf and thus concludes the 
proof of the proposition. □ 

2.2. The Grassmann algebra 

The operation of taking the trace of a symmetric matrix on a subset is central 
in our problem. It is a complicated operation since it is rational. However we can 
embed the space of symmetric matrices in a Grassmann algebra in such a way that 
this operation becomes linear. This will be crucial in our work in order to construct 
a good renormalization map. This is the key tool we use to generalize some of our 
previous works (cf [38]). 

2.2.1. Definition. — As in 2.1, F is a finite set and \F\ denotes its cardinality, 
most of the time we identify F with {1,...,|F|}. Consider E and E two copies of 
C^, with canonical basis {r]^)x£F and {r]x)x£F- We consider the Grassmann algebra 
/\(E®E) defined by 

/\(F©F) = 0(FeF)^^ 

fc=0 
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where A denotes the exterior product. We denote by A the subalgebra generated by 
the monomials containing the same number of variables rj and 77, i.e. 

A canonical basis of A is 



(1, 77^l A • • • A ?7,^ A ly, ^ ■ ■ ■ ^ Vj,, h < ■ ■ ■ < ik, ji < ■ ■ ■ < jk, I < k < \F\). 

We endow A with < • , • > the scalar product which makes this basis an orthonormal 
basis. To simplify notations we will forget the sign A to denote the exterior product 
and simply write rjirjj for rji A rjj. Remark that the elements of A commute since A is 
generated by the monomials of even degrees. 

If Q is a _F X _F matrix then we denote rjQrj the element of A: 

We will be particularly interested in terms of the type 

1 / ^ \ 

exr 



fc=0 ■ \ i,3 J 



(22) = E E det((g).i,...,.,) 77,^,7,, •••77,^77, 



fe=0 ii<- ■<ifc 
il<- ■<Jfc 

where (Q) ii i^. is the k x k matrix obtained from Q by keeping only the lines 

Ji jfc 

ii, . . . ,ik and the columns ji, ■ ■ ■ ,jk- 

Lemma 2.1. — Let Q be a complex \F\ x j.F'l matrix, then 

(23) ||exp77Q77f = det(/d+ QQ*) 

(24) = ni£i(i + pD 



where Pi < ■ ■ ■ < p\F\ the characteristic roots of Q, i.e. the eigenvalues of ^/Q*Q, 
and II II is the norm induced by the canonical scalar product < •, • > on A. 

Proof: It is well-known that we can find unitary matrices U, W such that 

/ Pi 



Q = W 



\ 
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Denote C = (i.e. Cfc = W^^kVi for all k) and ^ Uij (i.e. Vfc = J2j Uk.jfpj), 
we have 



f Pi \ 

exp{rjQr]) = expC 



\ P\F\ 1 

\F\ _ 

= 1 + 51 ^i^' + H ^'1 C»i V'ia + • • • 

i=l i\<ii 

+Pl ■ ■ -PlFI Cl^l ■ ■ ■C|F|'0|F| 

But the family of vectors {\, (Citpi), (Ci^i^hCi^'^ii), ■ ■ ■ Xi^Pi ■ ' ' C|f|V'|f|) is orthonor- 
mal, so we proved (23). □ 

If Y is in A we denote by iy the interior product by Y, i.e. the linear operator 
iy ■ A ^ A defined by 

(25) <iY{X),z >^< x,YZ >, yx,zeA. 

In particular, remark that 

«n,eF77^r,,(exp77Q77)) = detQ. 

Suppose now that F' is a subset of F, and denote by Af' the subalgebra of A 
generated by the variables {rjx)xeF'^ {Vx)xeF'- We define the linear operator 

(26) Rf^f' ■■ a ^ Af' 

Remark 2.3 : The operator Rf^f' is often presented as an antisymmetric integral. 
More precisely, Rf-^f' {X) coincides with the antisymmetric integral of X with respect 
to Ii^(zF\F'd'rix^x^ Rf^f'{X) = J Xli^^FXF'drixfix, as defined in [5] (cf also 
[47]). The antisymmetric integral appears in the context of supersymmetry, as an 
antisymmetric counterpart of the Gaussian integral. It is interesting to note that 
supersymmetry has been used in the context of random Schrodinger operators several 
times (cf for instance [28], [47], [51] and references therein). 

Proposition 2.2. — Let Q he a complex symmetric F x F matrix, we have 

(28) det{Q) =< Rf^f' {cxpT]Qij),Ila:(zF>rj^T]j; >, 

(29) detiQ\F\F') =< RF^F'{expr]Qri),l >, 
and 

30) exp{r]QF'V) = — -7—7-^ r — , 

det(Q|F\F') 

when det{Q\F\F') 7^ 0. 
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Proof: The first two formulas arc simple consequences of the definitions. For a 
matrix Q we denote by det((5 ) the determinant of the matrix where we keep 

31, ---,3k 

only the lines ii, . . . ,ik and columns ji, . . . ,jk, and by det{Q^^ ) the determinant 

of the matrix where we removed the lines ii, . . .ik and the columns ji, ■ ■ ■ ,jk- It is 
well-known that 

det(Q^i:-:-:^' ) = det((g-i) .1 ) det Q. 

31 3k 

Let ii < • • • < ife, ?i < • • • < i\F'\-k be elements of F' such that 

{ii, . . . . . .,i\p,\_k} = F' , 

and ji < • • • < j'fe, ii < • • • < ]\F'\-k be elements of F' such that 

{.71, • ■ • , Jfe,ii, • ■ ■,]\F'\-k} = F' . 

We have 

< RF^F'{eyiv'nQ'n),Vii^n ■ ■ -Vt^Vjk > 

= det(Q''^--'>'i-'=) 

= detQdet((g-i).i .|^,,_J 

A Ufn ^ . detg 

= ^^*«^^')ra')d^i(g;o 

detQ _ 
" ^ d^t(Q^*^''P''*^^"^'''*i''^' ^ ■ 

Evaluating the equality for fc = we get 

detQ 



< R-F^F'icxpriQri),! >= dct{Q\F\F') 



dot Q F' 

and this is enough to conclude the proof of the proposition. □ 

Let us introduce a notation: if / is a holomorphic function from a domain D C C" 
to C™ then we denote by ord(/, xq) the order of vanishing of / at the point ^ D, 
i.e. the maximal integer p such that one can find an open set U containing a;o and 
holomorphic functions /iii....,ip, \ < ii < . . . < ip < n on U such that 

^ (a;,;^ -a;° -a;°J/i,;i,...,,p(.T), onU . 

ii<----<ip 

li Q is a F X F symmetric matrix then we denote by kcT^^{Q) (for the Neumann- 
Dirichlet kernel) the subspace ker^'^(Q) = {/ G ker((5), f\F' = 0}. 

Proposition 2.3. — i) If Qo is a symmetric F x F real matrix then: 

(31) dim(ker^^(Qo)) = ord{Q ^ RF^F'{cxpfiQij),Qo) , 
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where in the right hand side Q is taken from the set of complex symmetric F x F 
matrices. 

ii) Moreover, if B is a real positive definite symmetric F x F matrix then 

(32) dim(kcr^-°(Qo)) = ord{X Rp^F'icxpfjiQo - XB)r)),0) . 

Remark 2.4 : The fact that the matrix Qo is real is crucial since this result is 
essentially related to the fact that this matrix is diagonalizable. 
Remark 2.5 : A priori the order of vanishing of the function 

A RF^F'icxp7]{Qo - Ai?)7^) 

at A = is greater or equal to the order of vanishing of Q — > Rf—>f'{g'^PvQ''1) Qo- 
The point ii) tells us that there is actually equality, i.e. that the line {Qq — XB, A € C} 
intersects transversally at A = the analytic set {Q s.t. Rf^f' {exprjQii) ~ 0}. 

Proof: i) The point i) is a consequence of ii). Indeed, the order of vanishing of 
Q Rf^f' (cxprjQrj) is equal to the order of vanishing in a generic direction. Oth- 
erwise stated, this means that there is a proper analytic subset A C Symj;. such that 
for any direction B in Sym^ \ A the order of vanishing in i) is equal to the order of 
vanishing of the function A (exp^((5o ^ ^B)if} at the point A = 0. Denote 

by Sym^jj the space of real symmetric F x F matrices, regarded as the set of real 
directions in the tangent vector space Sym^. Since A is analytic, AC\ Syvap^ is of 
empty interior. Considering that the subset of B in Sym^^jj which are positive defi- 
nite is open in Sym^^^, we know that this set cannot be contained in A, hence if we 
assume ii) we know that dinikcr((3o) is the order of annulation in a generic direction. 
Hence ii) implies i). 

ii) We first derive an explicit expression for T{Qq — XB). Since Qo is real and B real 
positive definite we can diagonalize (Qo)|f\_f' in a-n orthonormal basis for B\f\f', i-G- 
we can find eigenvalues A^, . . . , A|^^^,| and a family of functions f^,..., f^-^p,^ in 

M^\-^' such that 

< fk^Bfk' >F\F'= Sk,k' 
iQQ)\F\F'fk = KiB\F\F')fk ^ 

where <,>f\_F' is the usual scalar product on R^\^ . For a real function / on F' 
we denote by H\f the harmonic prolongation of / with respect to Qo — AS. The 
function H\f can be written 

\F\F'\ 

Hxf = f+ J2 ""^fk^ 
fe=i 

and we easily get 

<fA{Qo-\B)fr\p, >F' 
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We set (f>k.\ = {{Qa — ^B)f^. )\p, and wc denote by pk,\ ■ the projector 

given by Pk,\{f) =< /, ^fe.A >F' (f'k.x- Thus we have from proposition 2.1 ii) 

\F\F'\ 

TQ = {Qo-\B\f-+ V 

k=l ^^^k 

Denote now by the dimension of ker^^((5o)7 a-nd by nf, the dimension of ker((Qo)|F\i=")j 
so that riQ > ??o. This means that rig of the eigenvalues AjT are nuU. We ean as well 
suppose that = • • • = A^, = and that /]",..., form an orthonormal basis 

(w.r. to B) of ker^^((5o)- This implies that for k < no, Qof^ — a-^id thus that 
0fc,A = KBfk)\F'- For fc < we denote by -pk : the projector given by 

Pkif) =< f,{Bf-)^F,>{Bf-)^F, 

and we have p^.A = X^Pk- For fc > no + 1 we simply denote ipk = 0fc.o and pk = Pfc,o- 
The functions {4>k}k=no+i,...,n'g are linearly independent. Indeed, otherwise there 
would exit a linear combination of the /jT, k = no + 1, . . . , ng. belonging to ker^^((5o)- 
This is not possible since the dimension of her^^ {Qq) is no. 

Considering relation (30), we see that for small A's the function Rf^f' {sxp{r]{Qo — 
XB)ri)) can be written 

(_A)"o I II (A--A)| exp(^(go-Ai3)|j.-77) 

"o ^ \P\F'\ ^ no 

exp(??( jPkA)v) (^^Pivi y7-^Pfe-A)'7)exp(A77(^pfe)7;) 

A;— ?iQ + l A:— n[-) + l ^ k—1 

= CA"» exp(77Qof?) exp(^( ^ -pfc)??) exp(^( ^ — Pfc)?7)(l + o(A)) 

where C is a non null constant. Considering that the operators pk have rank 1, the 
last expression equals 

n'o \F\F'\ 

CA"" n iX + VPkv)oMvi J2 —Pk)v)a+o{X)). 

k—no + l k—n'f^-\-l k 

From this we deduce that A"" can be factorized in the last expression, hence that the 
order of vanishing of the function A RF^F'icxpviQo ~ XB)rj) is at least no. In 
the last expression, the term of degree Uq — no in the variables rj and in the variables 
rj is 

A"° Y\_ (WkV) + (terms of order A'', fc > no). 

fc— no +1 

Since the pfc's are linearly independent YVk'Lno+i^^Pk''l) ^'-'^ null. This proves that 
the order of vanishing of A RF^p'ic^PviQo — XB)ri) is exactly no. □ 
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2.2.2. The Lagrangian Grassmannian. — Wc denote by Synij;, the space of 
eomplex symmetric \F\ x \F\ matrices. We denote by ViA) the projective space 
associated with A and by tt : ^ ^ T^iA) the canonical projection. It is clear that the 
map Q Tr{cxp{fiQr])) is injective and hence defines an embedding of Sym^ in V{A). 
In this section we describe the subvariety defined as the closure of the set of points 
of the type 7r(exp(77Q77)) for Q in Sym^;,. This subvariety defines a compactification 
of the set Sym^, and we will see that it is a Lagrangian Grassmaniann. This type of 
compactification already appeared in the context of electrical network, cf [9], [10]. 

We first recall some classical notions. Let n be an integer and (•, •) be the bilinear 
form on C^" given by {X, Y) = J2 ^i^i and J be the 2n x 2n matrix given by: 




where /„ is the n x n identity matrix. 

Obviously (•, J-) is an antisymmetric non-degenerate bilinear form (usually called the 
symplectic form when considered on M^"). 

Definition 2.2. — A linear subspace L ofC'^'"' is called Lagrangian if for all x,y in 
L, {x,Jy) = 0. 

We denote by L" the set of n-dimensional Lagrangian subspace of C^". It is 
a homogeneous space. It can be indeed described as the quotient of the complex 
symplectic group by the stabilizer of a point. Therefore L" is a "^'y"^'* compact smooth 
manifold. To precise the situation we describe explicitly a local parameterization. At 
a point L the set L" can be parameterized explicitly by the space Sym„ of symmetric 
nx n complex matrices. Indeed, if (wi, . . . , w„) and {v[, . . . , w',) are orthonormal basis 
of respectively L and L-^ (for the usual scalar product on C^" and L-^ the orthogonal 
subspace of L for this scalar product) then the map 

Sym„ ^ L" 

(33) Q ^ Vcct{v^+J2Q^.JVJ}^=l■■■n 

3 

defines a local set of coordinates. Indeed, it is easy to check that the subspace 
Vectjwi + Qi,jv'j}i=i...n is Lagrangian and that any Lagrangian subspace in a 
neighborhood of L can be represented in such a form. 

Let (ei, . . . , e„, e'^, . . . e^) denote the canonical basis of C^". We denote by 7'(A"C^") 
the projective space associated with A"C2" and by tt : A"C2" 'P(A"C^") the 
canonical surjection. Classically, the manifold L" can be embedded in the projective 
space 7'(A"C^") by the Pliicker embedding 

L" ^ -P(A"C2") 

(34) L = Vect{a;i, . . . , a;„} 7r(a-i A • • • A a;„). 



We come back now to the Grassmann algebra introduced in section 2.2.1. Take 
n ~ \F\, the subalgebra A can be easily identified with a'^IC^I^' by the isomorphism 
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defined on monomials by: 

(35) e,, A--- Ae,|^|_, Ae;^ A---Ae;^ ^ i-^P''=''' "^'"Vi^Vn ■ ■ -Vi.Vj,, 

where ii < ■ ■ ■ < i\F\~k^ ji < ' ' ' < ik and li, . . . ,ik is defined by ii < • • • < ife and 
{Zl,. . . . . . ,l|F|-fc} = {1, . . . , |i^|}. 

Thanks to the embedding (34) and the isomorphism (35) the manifold L'^' can be 
considered as a smooth subvariety of V{A). ft is easy to see that by the isomorphism 

(35) the point 

Al='i(e. + ^Q.,,e,) 

is sent to the point exp{fiQri) and thus that Tr{exp{riQri)) is in lI^I. Hence we deduce 
the following 

Proposition 2.4- — The application Q — > 7r(exp 77(577) defines an embedding of the 
space Synip of F x F symmetric matrices into the smooth projective subvariety L'^L 
More precisely, the set Symp is sent onto the subset L'^' \7r{X G A, < X,l >= 0} . 
Hence, the closure of the set of points of the type 7r(exp 77(57;) is equal to L'^L 

Remark 2.6 : Therefore the set L'^' defines a compactification of Sym^. There are 
many different compactifications of Sym^ (for example, in section 4.4 we consider the 
compactification by a projective space) but this one seems to be the best-suited to 
our problem. 

We will need some results on the dimension of the cohomology groups of L'-'^I . We 
recall from [42] that the first and second betti numbers are given by: 

(36) 61 = dim(i7i(Ll^l,C)) = 0, 62 = dim(i72(Ll^l,C)) = 1. 

The manifold L'^' is a Kahler manifold, as a smooth projective subvariety. A natural 
Kahler form on L'^' is the restriction of the Fubini-Study form on V{A) (cf appendix 
A. 5): we call this form the canonical Kahler form on L'-'^I. By definition, the Kahler 
form is in H^'^{lJ-^^) the (1, 1) Dolbeault cohomology group of L'^' (which coincides 
for Kahler manifold with the subspace of H^{lJ-^^, C) generated by the forms of the 
type (1, 1), cf appendix C). Thus we have by (36) and general results on Kahler man- 
ifold that dim(i/2.0(Ll^l)) = dim(i/0'2(L|F|)) ^ q dim(i7i'i(Ll^l)) = 1. 

G-invariant Lagrangian Grassmannian 

We suppose now given a finite group G acting on F. We denote by L'-^ the closure 
in L'^I of the subset Sym*^, the space of (7-invariant complex F x F matrices. As we 
shall see in appendix E, L*^ is a smooth projective variety, whose structure can be 
cxplicitely described. It is also clear that for the isomorphism (35) the submanifold 
L*^ is the closure in V{A) of the points of the type ^{exprjQri) for Q in Sym'^. 

Remark 2.7 : Assume that F' is a subset of F, invariant by the group G. The 
element it{Rf^f' {&^PvQv)) is then in the (7- invariant Lagrangian Grassmannian as- 
sociated with F' . Moreover, remark that formula (31) of proposition (2.3) remains 
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valid for Qq in Sym*^ if wc let Q run in 8701*^ instead of Sym^. Indeed, using ii) of 
proposition 2.3, wc know that for B real symmetric positive, G-invariant 

dimker^^(Qo) = ord(A ^ i?F^F' (exp?7(Qo - AS)//), 0) 
> ord(Q Rf^f' (exp (77(377)), Qq) 

for Q running in Sym*^. This last expression is bounded from below by the same 
expression for Q running in Sym^ instead of Sym*^, which is equal to dimker^^((5o) 
by proposition 2.3, i). 

2.3. Trace of a Dirichlet form in the continuous situation 

We recall here some results from [38] that will be useful for the continuous case. 
Let X be a locally compact denumerable metric space and 771 a finite positive Radon 
measure on X such that supp(77i) = X. 

Let (a,I?) be a regular Dirichlet form on L'^{X,m) such that: 

(i) a is irreducible (i.e. a(/) = implies that / is constant). 

(ii) (a, 2?) has a compact resolvent. 

(iii) There exists c > such that capj^dx}) > c for all x G X. 

N.B.: capi{{x}) stands for the 1-capacity of the point {x} (cf [17], section 2). 

The assumption (iii) implies in particular that the functions of the domain have a 
continuous modification, so that the value at one point can be defined (cf [17], the- 
orem 2.1.3). A second implication of assumption (iii) is that the resolvent Rx is 
trace-class (cf [38]). 

Let F be a finite subset of X. The regularity of the form and assumption (iii) 
imply that for any / G there exists g € T) such that g\F = f- 
We define the trace of (a, V) on the subset F as the bilinear form on defined by: 

(37) aF(/,/) = inf{a(.g,.g),.geI?,g|F = /}, V/ G R^. 

The irreducibility of (a, V) implies that the infimum in (37) is reached at unique point 
called the harmonic continuation of / with respect to a. 

If F is endowed with a positive measure b with full support then (of, R^) is a regular, 
irreducible Dirichlet form on i^(F, b) (the process associated with qf and b on states 
space F can be represented by a time changed of the initial process associated with 
(a,P) on L^{X,m) (cf [17], theorem 6.2.1). 

For A > 0, let a\{f) — a{f ) + \Jx Pdm for / £ P. The bilinear form a\ is a regular 
irreducible Dirichlet form satisfying (i), (ii) and (iii). We denote by As^x) the F x F 
symmetric matrix given by < ^(a)'i ' (aA)p'(', •) where < •, • > is the usual scalar 
product on R-^, and by H\f the harmonic continuation of / £ R^ with respect to ax, 
so that < A(A)(/),/ >= ax{Hxf,Hxf). 

Set T>~ ={/€!?, f\F = 0} (N.B.: I?~ is the domain with Dirichlet boundary 
conditions on F; (a,P^) is a regular Dirichlet form on L'^{X \ {i^},777)). 
We denote by > Aj^ > • • • > A^ > • • • the negative eigenvalues of the infinitesimal 
generator associated with (a, V) and by ctq the multiplicity of the eigenvalue (which 
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can be or 1, indeed ao ^ 1 if 1 E V and otherwise). 

We also denote by > Aj^ > • • • A^T > • • • the eigenvalues of the infinitesimal gen- 
erator of {a,'D~) (in this case is not eigenvalue because of the boundary condition 
and assumption (i)). Let fi,...,f^,... be an orthonormal basis of eigenfunctions 
associated with the preceding eigenvalues. 

Lemma 2.2. — (^38], lemma 2.1.) For any ,/ £ M^, A > 0; 

(38K ^(A)(/), / >=< ^(0)(/), / > +A / W fdm - A^ £ {jHoff^dmf ^ 

k=i 

In particular ^(a) is meromorphic on C with at worst simple poles at the points 

{Ar,...,A^...}. 

We define some infinite dimensional determinants by the following formula: for 
A e C we set 



(39) rf+(A) = A-«nr=i(l--^), 



(40) d-(A) = n-i(i--^). 

The existence of these functions comes from the fact that the resolvent of (a, V) and 
(a,I?^) are trace class. 

Lemma 2. 3. — There exists a constant C > such that for all 
AeC\{Ar,...,A-,...}; 

(41) '^^^(A.))-^^!^. 

A proof of this result is given in [38]. A more general version of this result, but 
valid only for differential operators on R''. can be found in [15]. 
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THE RENORMALIZATION MAP. EXPRESSION OF THE 

DENSITY OF STATES. 



3.1. Construction of the renormalization map. 

In section 3 wc will only be interested in the density of states. Therefore, since 
the counting measures i^<„> do not depend on the particular blow-up, we suppose to 
simplify notations that cj^ = 1 for all k. 

3.1.1. On the set of symmetric FxF matrices. — We come back to the situation 
described in section 1 and denote by Sym^ the space symmetric FxF matrices. We 
denote by Sym*^ the subspaces of Sym^ of G-invariant matrices, i.e. of symmetric 
matrices Q satisfying: 

9-Qf^Q{gJ), VgeG,V/eC^. 

Starting from Q in Sym^ we can construct a i^<i> x -F'<i> symmetric matrix Q<i> 
by: 

Q<i>{f) = ^aiUi^Q^iy^i, 

i 

where (3<i>,i is a copy of Q on the cell i^<i>,j;, i.e. it is a i^<i> x F<i> symmetric 
matrix defined by 

f (<9<i>,i/)|F<i>,i = <9(/|F<i>,J, 
1 Q<i>Af{x)=0, iix^F^iy^,, 

for all / in M^<i> . 

On the set {det((5<i>)|F<i>\aF<i> 7^ 0} we consider the trace on 9F<i> of Q<i>, 
which is an element of Sym^. So we define: 

T : Sym^ Sym^ 
(42) Q (Q<i>)9F<i>. 

Considering the symmetries of the structure we see that TQ is G-invariant if Q is 
G-invariant, i.e. T(Sym'^) C Sym*^. In all the following we will rather consider T as 
a map on Sym*^ than on Sym^,. Using proposition (2.1) we know that the map T is 
rational with poles included in the set {det{Q^i^)\p^^^\^gp^^^ = 0}. 
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Let 5*+ denote the set of complex symmetric F x F matrices with positive definite 
imaginary part: 

(43) 5*+ = {Q complex symmetric F x F matrix,, Im(Q) is positive definite}, 

and set S'^ ~ S+ H Sym'~^. Usually, 5*4- is called the Siegel upper half-space (cf [46], 
[50]). In the next lemma we prove a key property of T, which is that 5+ is left 
invariant by T. We also give some estimates, useful in lemma 3.3, to bound the speed 
at which the iterates of T approach the boundary of S+. In appendix D, we present 
a different approach which avoid all explicit estimates, but only uses properties of 
contraction of holomorphic maps on . 

For a matrix Q we denote by p{Q) and p((5) the minimal and maximal characteristic 
root of Q (i.e. the minimal and maximal eigenvalues of \/Q*Q). 

Lemma 3.1. — The map T is well-defined and holomorphic on S+ (resp. on S^) 
and 5+ (resp ) is T -invariant. Moreover for all Q in S+ we have 

(44) p[Im{TQ)) > aia-^pilmQ), 

(45) p(/m((rQ)-i)) > a^'MMQ-')), 
where a = mf{ai}, a = sup{ai}. 

Proof: It is clear by proposition (2.1) that T is well-defined on S+. We first derive an 
expression for lm{TQ). Let Q = ReQ + ilmQ be in Sj^. Let / be a real function on 
F (which can also be considered as a real function on 5F<i>), and Hf its harmonic 
prolongation with respect to Q<i> (which can be defined for Q in S-i- using proposition 
(2.1)). We have: 

<TQfJ> = <Q<iyHf,Hf> 

= <0<i>i//,Rei//> 

^ < RcQ<i>ReH/, RcHf > +i < ReQ<i>Imi?/, RcHf > 
+i < ImO<i>Rci7/,Rci7/ > - < ImQ<i>Imi7/, Rci?/ > 

Considering that < Q^iyHf,lmHf >= we deduce the following identities: 

< ReQ<i>ReH/,ImH/ >=< ImQ<i>Imi?/, Imi?/ >, 
< ImQ<i>ReiJ/,Imi?/ >= - < ReQ<i>Imi?/, ImiJ/ > . 

Replacing in the expression of < TQf, f > we get 

< ImTQf, f> = < ImQ<i>Rei7/, RcHf > + < ImQ<i>Imi?/, ImHf > 

N 

> < ImgRei7/|;^^^^^,Rei//|j.^,^ . > 

i=l 

Since Im((5) is positive definite we deduce from the last expression that < Im{TQ)f, f » 
since Re{Hf) is not zero, and thus that TQ is indeed in S-^-. From the last inequality 
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we can also deduce 

N 

< lmTQfJ> > p(IniQ)aia-i ^ < Rci?/,;^^,^ , , Rei7/|f,,, , > 

i=l 

> p{lmQ)aia-^\\f\f. 

Thus formula (44) is proved. 

To prove equation (45) we need to express Q<i> in terms of by a kind of 
harmonic prolongation (just like TQ is expressed in terms of Q by a harmonic pro- 
longation). This is done in [37] in a slightly less general context. We state without 
proof the following lemma (the proof is a simple algebraic manipulation and essen- 
tially similar to the proof of proposition 1.1 of [37]. Note that this technical lemma 
can be avoided, cf appendix D.) 

Lemma 3.2. — Let v he in and he the set 

N 

// Q is invertihle then there exists a unique {vi, . . . , vn) in T^y such that 

N 

for all (i>i, . . . , vn) in Vq, and we have: 

((Q<i>)"^i^)|F<i>,, = aj'^QfiQ^^i^j. 

Let Q be in 5"+. We have p{Im{{TQ)-^)) > p(Im((g<i>)-i)). Let v be in R^<^> . 
Proceeding just as previously we can prove: 

N 

< Im((Q<i>)^^)i/, u > = ^ ai^ai{< Im(Q^^)Re^'i, Ret^i > -I- < lm{Q^^)lmi^i,lmiyi 

i=l 

N 

> p(Im((5^^)) ^ Q;^^ai(< Ret'ijRet'i > -|- < Imfijlmz^i >) 

i=l 

> p(Im(Q-i))ar'a|kll', 

where (z/i, . . . , ujsr) is the element of V^, obtained from lemma (3.2). Thus we have 
proved formula (45). □ 

3.1.2. The map R defined on the Grassmann algebra. — Consider the Grass- 
mann algebra with generators {rj^, rix}xe f and A its subspace generated by the mono- 
mials containing the same number of variables rj and rj (cf section 2.2). We denote by 
^<i> the counterpart for the set i^<i>. Remind that the elements of A and yl<i> 
commute since they contain only monomials of even degrees. 

The canonical injections Si : F ^ F<i> given by Si{x) = (i,x) naturally induce the 
morphism Si : A^ -^<i> defined on the generators by: {rj^^rj^) {Vsi{x)T''lsi{x))- 
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For a real (3 > we denote by the linear map defined on monomials by: 
Tp : A A 

■ ■ • ■ • • '^jfc ^ f^'^'^ii ■ • • ■ ■ ■ ■ 

Then we set 

T"/3i,...,/3jv : -4 A<cl> 

X ^ si(T^,(X))...,s^r(r^„(X)). 
Using the commutativity of the subalgcbra ^<i>, with these definitions, we get: 

expr7Q<i>77 = HfLiCxpiaia^^rjQ^^iy,,?]) = T^,„-i,._a,„^i (exp rjQr?) 
Finally, using the construction of section 2, we define the map i? : ^ — > ^ by 

For Q in Synij^, we denote by Q^n> , the F^n> x F^n> , G-invariant, symmetric matrix 
defined, as in formula (11), by 

N 

^ • • ■a^^^Q<«>,ii,...,i„, 

where Q<n>,ii,...,i„ is the copy of Q on i^<n>,ji,....in i in section 1.2.1 (N.B.: remind 
that here we suppose uJi = 1 for all i). Similarly Q<:n>,k denotes the F^n>,k x F^n>,k 
matrix defined by 

AT 

Q<n>,k= ^ Q;" ^C^i^^ ■ ■ ■ '^i^Q<n>,kAl,...,i„■ 
i2,■■■,^n=^ 

Proposition 3.1. — i) The map R is polynomial homogeneous of degree N. 
ii) We have the following relation: 

(46) -R"(exp77Q77) = C<„>det((g<„>) o ) exp(77T"Qr;), 

V I J* <n> / 

where C<^n> is a constant depending only on the Ui 's 

c<„> = (^«l«fc^)^-'|^<■>|"'"""^ 

fe=l 

N.B.: For any matrix Q in Sym*^, Q<^n> is the G-invariant, symmetric i^<n> x i^<„> 
matrix with complex coefficients defined by formula (11), where A is replaced by Q. 
Proof: i) The map t^^, (^) is obviously homogeneous polynomial of degree N in 
the coefficients of X. The map i?F<i>— >ap'<i> is linear. 

ii) We clearly have, using, for example, the variational formula of proposition 2.1 
that T'^Q is the trace on 9F<„> of Q<n>, i-e. 

(47) T"g = (Q<„>)aF<„> 

(where as usual we identify 9F<„> and F). Iterating the map R we have 

(48) i?"(exp(?7Q77)) = G<„>in » ^,r,, (cxp(?70<„>77)) , 
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where as usual wc identify the points of i9i^<„> with the points of F. Let us prove 
the last formula by recurrence. Suppose that for n > 

i?""^(exp(?7Q?7)) = C<„_i>in „ Tj^r,, (cxp(?jQ<„-i>?7)) . 

^e-P<n-i> 

By definition, for all k in {1, . . . , N}, if we identify i^<i>,fe with dF^n>,k we get 
(«ia,Ti)l^<"->Ufe(T„^„-.(i?"-i(expryQr/))) 
= C<„_i>in o v^ri^ (exp(Q;ia^^77(3<„>,fc77)) . 
Considering that the term exprjQ^n>,kV does not contain any term rj^,7]x for x in 

o 

F<n>,k' and k' ^ k, we see that 
n(*n o r?,r,, (expaia^^77Q<n>.fc'?) I = «nfl, n = « r,,(exp^Q<,i>f?) 

fc=l V k / 

since Q<n> = ^^=iCti'^k^Q<n>,k- Formula (48) follows directly this last equality 

o 

since C<„> = C'^„_i>(nfc cti^ctkY^'^"^^^^ ■ We see then that formula (46) is a direct 
consequence of formula (48), (47) and proposition (2.2). □ 

We denote by ViA) the projective space associated with A and by tt : ^ ^ T^iA) 
the canonical projection. We denote by L'-^ the closure in 'P{A) of the elements of the 
type 7r(exp(?/(3?7)) for Q G Sym'"'. We know from section 2.2.2 that L*^ is a smooth 
subvariety of the Lagrangian Grassmannian L'^', with the same dimension as Sym*^. 
We remark from (46) that 7r~-'^(L'-^) U {0} is invariant by R. 



3.2. The main theorem in the lattice case 

We define the Green function (cf appendix B) associated with R as the map G : 
^ ^ M U {-oo} given by 

G{x)^ hm -i-ln|ji?"(x)||, xeA. 

n — ^oo jv 

This limit always exists and is a plurisubharmonic function (cf Appendix A & B). This 
function is related to the dynamics of the map on V{A) induced by R (cf appendix 
B). 

For X g L*^ we denote by Pn{x) the order of vanishing at x of the restriction of 
the map i?" to the submanifold L'^: precisely if s : U ^ A is a local holomorphic 
section of the projection tt on an open subset U C L'-^ containing x, then we denote 
by Pn{x) = ord(_R" o s, x) the order of vanishing of the function i?" o s at the point x 
(cf section 2.2). The functions p„ satisfy: 

Pn+l{x) > Npn{x). 

since R is homogeneous of degree N . Thus the limit 

Poo{x) = lim -^pn{x), 
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exists since p„ is bounded by N", the degree of i?". 

Remind that in section 1.2.1 we fixed a difference operator A with real coefficients 
and a positive measure b on F. We denote by /fc<„> (and simply 1^ = Ib^o> ^'^^ n = 0) 
the diagonal F<„> x F<„> matrix with diagonal terms (/h<„>)a;,x ~ ^<n>(a;). We 
denote hy (f> : C ^ A the map 

(49) 0(A) = cxprjiA - \h)f], A G C. 

Remark 3.1 : Remark that the map is polynomial (cf formula (22)). 

Proposition 3.2. — i) The Neumann and Dirichlet spectrum are related to the map 
R hy the following formulas: 

(50) i.<„> = ^Aln|<i?"o0(A),l>| 

(51) i^+„> = ^Aln| <i?"o0(A),n,e;^77,7?, > I 

where A denotes the distributional Laplacian. 

ii) The Neumann- Dirichlet spectrum is related to the zeroes of R" by the following 
formula: 

(52) ^^ii^^p„(^(0(A)))<5.. 

A 

N.B.: 5\ is the Dirae mass at A. The terms in the sum (52) are non null only for a 
finite set of points A. 

N.B.: we recall that < •, • > appearing in formulas (50), (51) is the scalar product on 
A defined in section 2.2. 

Proof: Using (48) and proposition (2.2) we get 

C<„>det((^<„> - A/6<„J o ) i?"o0(A),l >, 

C<„> det(^<„> - A/6^„> ) =< i?" o (j){X),n^^Fr]^rj^ > . 

Hence, formulas (50) and (51) come from the classical ^^AlnjAj = Sq. 

ii) The map Q — > iT{exp(7jQr])) is locally invertible from Sym*^ to L''. Hence, for any 

Qo in Sym , we have 

Pn{n{expr]Qoii)) = ord{Q i?" (exp (77(577) ), Qo), 

for Q running in Sym*^. By formula (48) we have 

R" (exprjQij) = C<n>RF^„:^^dF^„>{c^prjQ<n>r])i 

for any Q in Sym'^. This implies that 

p„(7r(exp^Qo??)) > ord(Q ^ i?F<„>^9F<„> (cxp 77(377), {Qo)<n>), 

where in the right-hand side Q runs in the set of F^n> x F<n> , complex symmetric 
matrices. For Qq real, the right-hand side equals dimker^'°(((3o)<n>) by proposition 
2.3. On the other hand, we have 

/9„(7r(exp^Qo'?)) < ord(A i?"(exp 77(^0 - A/b)r7), 0) 

= ord(A i?F<„>-*aF<„>(cxp?7(((3o)<n> - A/6<„>)),0) 
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and this last expression equals dimkcr^^(((5o)<n>) when Qq is real, by proposition 
2.3; ii). Thus we proved that for all Qq real we have 

(53) p„(7r(cxpry(3o??)) = dim kcr^-°(((3o )<«>)• 

Formula (52) is a direct consequence of this last formula since for any Aq in R we have 

^^<,f>({Ao}) = dimker^^((^ - Ao/h)<„>) = p„(7r((/.(Ao))).n 
Theorem 3.1. — i) The density of states is given by the following formula 

(54) /i=:^A(Go0). 

ii) The density of Neumann- Dirichlet eigenvalues is given by 

(55) y.""^ = Y^pMmmx- 

A 

Remark 3.2 : Remark from formula (49) that (j) is holomorphic, thus G o (/> is sub- 
harmonic and A(G o 0) defines a positive measure. 

Remark 3.3 : By construction, we have supp^ C M. This implies that G o (/) is har- 
monic on C \ R. This property can be seen directly from the dynamics of g. We know 
from lemma 3.3 that g is holomorphic on the Siegel upper-half space S*"*", and that 
is left invariant by g. On the other hand, is hyperbolic in the sense of Kobayashi, 
cf for example. [45], definition 2.1. This implies that 5^-1- is in the Fatou set of 
that G is pluriharmonic on S''j', and thus that G o </> is harmonic on {A, Im(A) > 0}, 
since 4>{\) G S'!^ for Im(A) < 0. 

Proof: The proof of ii) is a direct application of proposition (3.2), ii). 
i) By general results on subharmonic functions (cf for example, [24]) w.e know from 
formulas (50) and (51) that the weak convergence ■^!^<„> — > ^A(Go (f)) would be 
implied by the following convergence in Lj^^(C): 

(56) lim -Lin| <i?"o0,l > | = G o 0, 

n— »oo iV 

(57) lim -^ln| <i?"o0,n^gj.^^7y^ > I = G o (j). 
This will follow from 

Lemma 3.3. — For all Q in 5+ 

V 111/ i?"(exp^Q?7) 
i^^A^^"'< Hi?"(exp^Q,)|| '^^' ^ 

Let us finish the proof of the theorem before starting the proof of lemma (3.3). We 
only prove (56), the proof of (57) is strictly identical. We write: 

In I < i?" o 0(A), 1 > I ^ -L In I < 1 > I + ^ hi Hi?" o 0(A)||. 

]Sfn I " I I ||i?"o0(A)|| iV" " ^ ^" 
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The first term of the riglit-liand side is negative since | < ||^„°^|^j|| , 1 > | < 1, and 
converges to for A G C\]R since A—XIui is in S+ or in —S+ for A in C\K, using lemma 
(3.3). Therefore, we know that the sequence of psh functions log | < i?" o 0, 1 > | 
is uniformly bounded from above and converges pointwise to G o (j) for A in C \ M. 
Using proposition (A.l) of appendix (or proposition 3.2.12 of [24]) we know that (56) 
is true for the convergence in Lj^^(C). □ 

Proof of lemma (3.3). We first remark that the terms of the sequences in formulas 
(58) and (59) are non-positive. By proposition (3.1) and lemma (2.1) we have; 

ITiexp^Qrj^ ^ cxp7?r"Q77 

' ||i?"(exp^Qr;)||' ' ' ||exp?7r"Qr/!|' ' 

1 



exp^r^Qr^ll 



> 



1 _ / {p{{T-Q)-^)f 



(1 + (p(T"Q))0^ Vi + (p((r"Q)-i))V 

where p(r"(5) is the maximal characteristic root of T"(5 and p{{T"'Q)~^) the minimal 
characteristic root of {T"{Q))~^ . Since {T'"-Q)~^ is symmetric we have 

p((T"Q)-i) > p(Im((T"g)-i)) > <a->(ImQ-i), 

using lemma (3.1) in the last inequality. This is enough to prove formula (58). 

The proof of formula (59) works similarly. Using proposition (3.1) and lemma (2.1) 

we get: 

ITiexpjQTj^ _ |det(r"Q)| 



i?"(exp^Qr;)||' ' || cxp77r"Q77|| 

1 

> 




and we conclude similarly using lemma (3.1). □ 



3.3. The continuous case 

We know that the Dirichlct forms (a<„>,P<„>) introduced in section 1.2.2 satisfy 
the conditions i). ii), iii) of section 2.3 (cf [36]). For A > 0, we denote by a<„> the 
Dirichlct form defined by a<„>,A(/,5) = «<«>(/, .9) + A / /g(im<„>, and by A^,-,>,(\} 
the symmetric F^n> x F<n> matrix defined by 

< ^<n>,{\}', ■ >= (a<n>,A)_F<„> (•, •)■ 

We simply write A(^x) = A<o>,(A)- Using lemma (2.2) we see that ^<„>,(a) can be 
extended to a meromorphic function on C with poles included in the spectrum of 
o-<n>,\ with Dirichlct condition on F^n>, i-c in the spectrum of (a,I?~) (indeed, 
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^<n> \ F^n> is the disjoint union of copies of X). 
We see that 

(60) ^<n>,(A) = (^(A))<«>, 

with {A^x))<n> defined by formula (11) (where A is replaced by ^(a))- 

Proposition 3. 3. — For all X Cz C the following equality is satisfied ( when the terms 
are defined) 

Remark 3.4 : This means that, at least locally, A(^) is a holomorphic curve 
invariant by the map a^^T. We remark that A(g) is a fixed point of a^^T (in general 
the existence of this fixed point is equivalent to the existence of a self-similar diffusion 
on the fractal, cf [36]) and that the direction (7^^(a))a=o is an instable direction of 
ai^T since 7 > 1. 

Proof: For any / in ]R^^<i> ^ we have: 

ar^r(%))(/) = arn^<i>,(A))aF<,>(/) 

= ar^((a<i>,A)i=^<i>)9i=^<i>(/) 
= ar^(a<i>,A)aF<i>(/) 

where the last relation comes from the scaling relation a<i>.A = aia^x. □ 

Denote by d<„> the infinite dimensional determinant of (a<„> , f <„> ) , as in section 
2.3, and simply d^ = '^<o>- T^^^ infinite dimensional determinant of a<„> with 
Dirichlet boundary conditions on F^n> is equal, up to a constant, to (d^)^ (indeed, 

o 

^<n> \ F^n> is the disjoint union of N" copies of X)- Hence, if we apply lemma 
(2.3) to X^n> and -F<n> we see that 



(61) det(A<„>^(^)) = 4„> „ 



(62) det((^<„>,(;,)) o ) 



<">d-(A)^"' 
for some constants c<„>. 

Proposition 3.4- — Formula (50), (51) and (52) of proposition (3.2) are true in 
the continuous case on the open hall 5(0, |A]^|) with center and radius \Xi \ and 
when the function <j) : B{0, |A^|) A is replaced by 

(63) 0(A) = exp(?7^(^)77). 

N.B.: Remind that Aj~ is the first Dirichlet eigenvalue of a, and that A(^x) is well- 
defined on S(0, lAj^l). 
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Proof: On B{0, |) we have, using formula (61), and proposition (2.2), 

('^<n>)|S(0,|Aj;|) = (^^l'^ M<n>l)|B(0,|Aj;|) 

= (^^1° I dot ^<„>,(.)| + N^l^<o>)BiO,\X-\) 

= < i?"o0(A),n^eF^,.?7x > l)|B(o,|A-|)- 

This proves formula (51). The proof of formula (50) is similar. To prove formula (52) 
we first prove that 

(64) dim£;^,f> , = dimker^^(A<„>,(;,)) = dimker^^((A(;,))<„>) 

for < A < 0, where x denotes the vector space generated by the N-D 

eigenvalues of a<„> with eigenvalues larger that A. When this formula is proved then 
formula (52) is a direct consequence of formula (53). Remark that -E^^ \ ^ {f & 
, /|_F<„> = 0} = {0} (otherwise, there would be a Diriehlet eigenvalue of (a, T>^) 
with absolute value smaller than |A^|). Hence, if / is in E^^^ ^ then /|f<„> is non- 
null and in ker^^(A<„>_(;^)). Conversely, consider g in \iev^ ^ {A^n> ,{\)) ^ its harmonic 
prolongation with respect to is well-defined and is in E^^f^ ^. This means that 

the map / f\F^„y is a bijection from E^^^ ^ to ker^^(^<„> (a)), thus this proves 
the first equality of (64). The second equality is given by relation (60). □ 

Theorem 3.2. — All formulas of theorem (3.1) are true in the continuous case on 
the hall -6(0, |A^|) and when (j) is given by (63) as in proposition (3.4). 

Proof: It is similar to the lattice case, using lemma (3.3). We just have to check 
that A^^x) is in S+ for Im(A) < 0. This follows the classical relation 

Im(A(,) (/,/)) = -Im(A) j \Hxf\'dm, 

for / e and Hxf the harmonic prolongation of / with respect to a\ (we remark 
from the explicit expression of H\f given in the proof of lemma 2.1 of [38] that Hxf 
admits an analytic prolongation for ImA < 0). □ 
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4.1. The dichotomy theorem 

In this part we analyze the structure of the Green function G restricted to the 
subvariety 7r~^(L'^), or equivalently the current on L*^ with potential G|^-i(lG). This 
will give some information on the measures jj,^^ and /i. The structure of this current 
is related to the dynamics of the restriction to L*^ of the map induced by R on 
'P{A) (indeed as seen in section 3, the subvariety 7r~^(L'^) is invariant by R). We 
first describe precisely this map. As in appendix C, we define the meromorphic map 
g : L'^ and its iterates by their graph Tg^ C L*^ x L'' constructed as the 

closure of the graph 

(65) ={(7r(x),7r(i?"(x))), x G tt"! (L^) \ {i?"(a;) = 0}}. 

We denote by 7ri,7r2 : L*^ x L*^ L*^ the projection on the first and second 
coordinates. The set of indeterminacy points of g", denoted Ig^ is defined (cf appendix 
C) as the set of points where tti : Tgn L*^ is not a local biholomorphism. On 
L'^\/gn the map is defined by g^{x) = 7r2(7rj~^(a;)). The codimension of Ig^ is at least 
2 and it will be useful to describe the structure of the set Ig^ in terms of the map 
R" . This can be done locally: let x be a point in L*^ and U an open subset of L*^ 
containing x, identified with a subset of C'*'™'^ by a local set of coordinates. If s is 
a section of the projection tt on the subset U then we can find holomorphic functions 
fi, ■ ■ ■ , fk on U and positive integers ci , . . . , c^- such that 

— we can write 

(66) i?"os = /[i...4^-i?„, 

where i?„ is a holomorphic function from U to A such that the set = 0} is 
at least of codimension 2. 

— The analytic sets 

(67) Z, = {/, = 0} 

are irreducible and fi is a generator of the idealX(2'i) = {/ holomorphic on U, / = 
on Z,}. 
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Then the set of indeterminacy points Ign OU is exactly the set {i?„ = 0} and on the 
set {Rn 7^ 0} the map is given by = 7r(i?„(a;)). 

This gives us the opportunity to introduce the divisor associated with the hypersur- 
faces of zeroes of the restriction of i?" to L'-^ . Precisely, we call divisor a formal sum 
^2 c^Z where the sum runs over the set of irreducible subvarieties of codimension 
1 of L*-^ and the coefficients cz are integers and null except for a finite set of indices. 
We define £>„ = J^czZ as the divisor on L*^ such that for any subset U C L*^ we 
have 

(68) {Dn)iu ^ ciZi + ■ ■ ■ + cZk 

where Zi and ci are defined by (66) and (67) (the restriction to U of an irreducible 
subvariety Z can be decomposed as a sum of irreducible hypervarieties of U: this 
naturally allows us to represent Dn H C/ as a divisor on U i.e. as a formal positive 
sum of irreducible hypervarieties of U). 

Since R is of degree N it is easy to see that 

(69) D„+i > NDn 

for the natural ordering on divisors. 

We denote by S (resp. 5„) the closed positive (1, 1) current on L*-^ with potential 
G'|7r-i(LG) (resp. (G'ri)|7r-i(LG) whcre Gn ~ ln||-R"||) i.e. S and Sn are defined locally 
on an open subset U of L'-^ by 

5 = d(i"Gos, =dd"log||i?"os||, 

if s is a holomorphic section of the projection tt on U . By definition the current 
5*0 is the restriction to L*^ of the Fubini-Study form defined on the projective space 
VIA) and is therefore a Kahler form on L'-^ (cf Appendix A. 5). The currents Sn 
are well-defined for all n since G„ is not equal to — oo on L*^ (indeed, we know 
that i?"(exp (77(377)) is non-null for Q in 5'+, cf lemma (3.1)). Since -^Gn converges 
pointwise in K. U {—00} to G we know that 

(70) hm -^Sn = S 

for the topology of current. 

In Appendix C.2 we define the pull-back of a positive closed (1,1) current by a 
meromorphic map. With this definition we have the following result. 

Proposition — For all integer n we have 

(71) Sn = [g'T So + [Dn]. 

N.B.: For a divisor D = J2 ^zZ we denote by [D] the current [D] = J2 cz[Z] where 
[Z] is the current of integration on the hypervariety Z (cf appendix A). 
Proof: Let U be an open subset of L'^ identified with an open subset of C'^""^ 
thanks to a local chart. If s is a holomorphic section on U of the projection tt then 
R" o s can be written (cf formula (66)) 
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and the map g" is defined on the set 7^ 0} by 

=^(i?„(x)). 

The current Sn is defined on U by 

= dd' In 1 1 i?„ 1 1 + ci dd-^ hi I M + • • • + Cfcdd^ In I M , 

with notations of formula (66) and (67). By Lelong-Poincare formula (cf appendix 
A) dd'=ln|/j| = [Z,] and we will show that dd'^lnpnll = (.g")*S'o on C/ \ {k,, = 0}, 
which implies the equality on all U since by Siu theorem (cf for example, [11]), a (1, 1) 
positive closed current cannot charge analytic subset of codimension strictly larger 
than 1. Let be in [/ \ {Rn = 0} and set = g[x(j). Let r > and ri > be such 
that g{B{xQ,ri)) C B(wQ,r). Let s be a holomorphic section of the projection tt on 
B(wo,r). We can write Rn{z) = i{z)s o g^^{z) on B{xo,ri) where j is a holomorphic 
function which does not take the value on the set {Rn 7^ 0}. This implies by defi- 
nition dd^log||i?„|l = (g")*^o on B{xo,ri) \ {]?„ = 0}. □ 

Considering equation (69) and relation (70) we know that the limit of 
exists and that the limit of -^{g^)* So exists. The question is now to know whether 
these limits can be non null at the same time. The following proposition answers the 
question. 

Proposition 4- 2. — If Dn 7^ for an integer n then 

lim i^(g")*5o = 0. 

The proof of this proposition relies on considerations on the cohomology classes of 
the currents Sn and is sent to section 4.2. Actually, this result would be straightfor- 
ward if L*^ was a projective space : it would be obtained by simple considerations on 
the degree as in the proof of theorem (A. 2) of Appendix B. We deduce from the last 
proposition the following results. 



Theorem 4-1- — "i) If Dn 7^ for an integer n then 

1 



S= lim ^jDn] 



and S is a countable sum of current of integration on hypersurfaces of L*^ . 

For both the continuous and the lattice case (i.e. for any choice of {A, h) in the discrete 

case) we have: 

(72) = 

in particular, for almost all blow-up the spectrum of the operator is pure point and 
the eigenf unctions have compact support. 

a) If Dn = for all n then the map g is algebraically stable (cf appendix C), 

S^ lim ^(<?")*^o 
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and S is the Green current of g. In particular, the current S does not charge hyper- 
surfaces and the support of S is included in the Julia set of g. 

Moreover, in the lattice case for a generic choice of {A, b) we have 

/.^^ - 0. 

N.B.: For a generic choice of {A, b) means for any {A, b) in the complement of a proper 
analytic subset. 

Remark 4.1 : The interesting information in this result is that a dichotomy appears 
between situations where either the N-D eigenvalues contribute for all the density of 
states or generically do not exist. 

Remark 4.2 : In proposition (4.4) we will relate this dichotomy theorem with an 
asymptotic degree associated with g. 

Proof: i) Since -j^[Dn] is increasing it is obvious that its limit will be a countable 
sum of currents of integration. It is equal to S by proposition (4.2). 

By proposition (3.2), ii) we know that (tt o (/))*[£)„] < n^n> (("' ° 4>)*[Dn] is the 
pull-back of the current as defined in appendix A. 6, i.e. on an open subset U 
the current [Dn] has potential ^ Ci log \fi\ where the q's and /^'s come from formula 
(66), the pull-back is then defined by (tt o </>)* [Dn] = dd'^ Ci log |/i o tt o ^|). There 
is not equality a priori since it may happen that the curve meets some component 
of {i?" = 0} of codimension larger than 2 which do not appear in [£>„]. This implies 
that [■KO(j))*S< 11^^, but {■KO(j))*S = n by theorem (3.1), so ^ n. 

ii) We will see in the next section that 5o satisfies an equation in homology 
N"{Sq} = (g")*({S'o}). Hence, S is by definition the Green current of g as de- 
fined in appendix C.4 and theorem (A. 3). It only remains to prove that for a generic 
choice of {A, b), = 0. Suppose that Z)„ = for all n. We want to prove that for 
a generic choice of {A, b) the hue A + Mb, A £ C, does not meet the set {i?" = 0}. 
This is equivalent to prove that for any choice of A as in section 1.2.1, and D positive 
diagonal, G- invariant, with TraceD = 1, in the complement of an analytic subset of 
codimension at least 2, the line A + XD does not meet the set R" = 0. But the map 

j : {A as in section 1.2.1} x {D diag. > 0, G-inv., and TvD = 1} x C Sym^ 

{A,D,X) A + XD 

is a local diffeomorphism for A 7^ 0. Therefore the subset 7^^((i?")^^{0})n{A 7^ 0} is 
of codimension at least 2. The set j~^((i?")~^{0})n{A = 0} is also of codimension at 
least 2 since i?" is not identically null on j({A = 0}). This implies that the projection 
of j~^{{R^)~^{0}) on the first 2 components {A, D) is of codimension at least 1. □ 

4.2. Proof of Proposition (4.2). Structure of the variety L''. 

4.2.1. Notations and preliminary results. — We denote by H^'^'^^iJj^) the 
(1,1) Dolbeault cohomology group of L*^ (cf Appendix C, iJ^-'^'^^ is equal to the 
subspace of H'^{LP , C) generated by the forms of type (1,1)). If a is a (1, 1) closed 
form we denote by {a} its cohomology class. As explained in the appendix the 
cohomology class of a current u) can also be defined and is denoted {lo}. 
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We remind from the appendix that if a is a positive closed (1,1) current then its 
puh-back is well defined and that if a is a smooth differential form then 

- (g")*a is in L^^iL^), 

— (g")*a is smooth on L*^ \ Ign. 

Moreover, the pull back (.g")* induces a pull-back on cohomology group H^^'^^h'^). 
We first prove the following result. 

Lemma 4-1- — For all integer n then: 

(73) {5„} = iV"{^o} = {g'TiSo} + {[Dn]}. 

Proof: The equality between {S'„} and the last term of the expression is immedi- 
ately deduced from proposition (4.1). We only have to prove that {5„} = A^'^ jS'o}. 
Remember that Sn has potential G„ = log||i?"l| on 7r~^(L'-^), and G„ satisfies the 
following homogeneity relation: 

G„(Aa;) =iV"log|A|+G„(a;). 

This immediately implies that {S„} = A^"{S'o}: indeed, the function m(z) = log ||i?"(z)| 
m log ||z|| is well defined on L<=^. Thus 5„ - N'^Sq = dd^u and {dd^u} = by defini- 
tion. □ 

4.2.2. Description of the structure of L*^. — To go further we need to describe 
the structure of the cohomology group H^'^{h'-^). In Appendix E, we describe the 
topological structure of L*^. The main point is that L*^ is isomorphic to the product 
Co X ■ ■ ■ X Cr, where Ci is a smooth projective variety with Betti numbers bi = 
dim(7J^(£i) = and 62 = dim{H^{£i) = 1. When G is the trivial group then 
L*^ = L'^I, and the situation is considerably simpler. We treat this case separately, 
for convenience, and the ready can restrict to this simpler situation, at a first reading. 
Let us be more precise. The structure of L'' depends on the decomposition of 
into real irreducible representations of G. The space can be decomposed into 
isotopic representation as 

(74) ^Vo®---®Vr, 

where each Vi is an isotopic representation equal to the sum of rii representations 
isomorphic to a single representation Wf. we write Vi = UiWi for simplicity. We 
denote by Vf' and Wf the complexifications of Vi and Wi. The representation Wi 
can be of one of the following 3 types (mutually exclusive). If Wf is C-irreducible 
we say that Wi is of type 2. Otherwise — Ui (B Ui, where Ui and its complex 
conjugate, Ui, are C-irreducible. If the character of Ui (and hence of Ui) is not real, 
then we say that Wi is of type 1. If the character of Ui (and hence of Ui) is real, then 
we say that Wi is of type 3 (cf Appendix E for details and justification). 

To state the result of appendix E, we need to introduce three types of Grassmanni- 
ans. We denote by G"'^" the Grassmannian of 71-dimensional subspaces of C^". The 
Lagrangian Grassmannian L" has been defined in section 2. Finally we define the or- 
thogonal Grassmannian as follows: O" is the set of n-dimcnsional isotropic subspaces 
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of C^" for the non-degenerate symmetric biUncar form (-^Kn-), where 

K - ( ^ Id„ \ 

The set O" is a smooth subvariety of G"'^", and has 2 connected components. We 
denote by SO" the connected component which contains the isotropic subspace C"0O. 

These three types of Grassmannian are homogeneous spaces associated respec- 
tively with the classical groups Gl{2n,C), Sp{n,C) and SO{2n,C) (cf Appendix E 
for details). 

In appendix E, we proved that 

L'^ ~ £o X • • • X Z;^, 

where 

— £i ~ (G"i'2ni jj: q£ type 1; the dimension of Ci is nf. 

— £i ~ L"' if Wi is of type 2; the dimension of Ci is ni{ni + l)/2. 

— Ci ~ §0^"' if Wi is of type 3; the dimension of Ci is 2?!^ — ti^. 

Remark 4.3 : Since the subspaces are orthogonal for the canonical symmetric 
bilinear form on C''^, the space Sym'^(C) is isomorphic to the product SyTn~^ (V^) x 
• • • X Sym'^(l^). The tangent space to L'-^ is Sym'^(C), and the dimension of each d 
corresponds to the dimension of SyTo^ {Vf') . 

Remark 4.4 : In particular, when all the irreducible representations of are 
realizable over E, then L*^ is a product of Lagrangian Grassmannians. This is the 
case in all the examples we are going to consider. 

The main point is that the first and second Betti numbers of Ci do not depend on 
the type of Ci and are equal to 

bi = dim(i/i(A,C)) = 0, 62 = dim(i/2 = 1 

(cf for example [22] for the case of G"^^"^ ^nd [42], for the case of L" and SO"). 
Since Ci is a smooth projective variety, and hence a Kahler manifold, it implies that 
i7i'0(A) = i?0'i(A) = {0}, H^'"{C,) = i/0^2(£^) = {0} and i/^'HA) ~ C (cf for 
appendix A. 5). Thus, 

(75) H'-\L^) = H^-\Co) © • • • e H^'HCr), 

and H^'^{L,'~^) is of dimension r + 1 (hence, we see that we are in the situation de- 
scribed in appendix C.3). Each of these Grassmannians have a canonical embedding 
in a projective space P*^: indeed, the Grassmannian G"'^" is naturally embedded in 
the projective space P(/\" C^") by the Pliicker embedding, and L" and SO" are subva- 
rieties of G"'^". We call canonical Kahler form on G"'^", L" and SO", the restriction 
of the Fubiny-Study form on the projective space P(/\"C^"), renormalized to be a 
generator of the integral cohomology H^'^ (cf appendix A. 5 and C.3). We denote by 
Vi the canonical Kahler form on each d. By abuse of notations we also denote by 
i^i the pull-back of ly'i by the canonical projection pi : Ci. A natural basis 

for H^'^{h^) is given by ({i^o}, • • • , Wr}) where {ui} is the cohomology class of Ui. 
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In this basis the puU-back (5")* on H^'^{L,^) is given by a (r + 1) x (?■ + 1) matrix 
dn (rfri,i,i)o<ij<r defined by 

r 

(76) = 

We know, cf appendix C proposition (A. 6), that (dn) has non-negative integer coeffi- 
cients. As explained in the appendix the matrix d„ plays the same role as the degree 
in the case of maps on projective spaces (i.e. if L*^ was a projective space P*^ then 
dn would be scalar (since dim if ^'^(P*^) = 1) and would be the degree of the map 5" 
as defined in appendix B). Before going further we detail two particular cases where 
this notion is easier to handle. 

The case L'=' =LI^I. 
This means that is the sum of \F\ times the trivial representation Wq. This 
happens if and only if G acts trivially on F. The cohomology group H^'^{h^) is then 
1-dimensional and the map (g")* is scalar and represented by the positive integer dn- 
In this situation the proof of proposition (4.2) is significantly simpler and we give it 
for the convenience of the reader. Considering relation (73) we have 

N"{S„}^dn{So}+{[Dn]}, 

thus Dn 7^ implies that dn < N". The sequence dn being submultiplicative (cf 
proposition (A. 6)) this implies lim„^oo j^dn ~ and then lim„_»oo '^{g^)* (So) = 
since the total mass of the current -^{g^)* (Sq) goes to zero. □ 

The case L*^ P^ x • • • x P^ (r+1 times). 

This occurs when Ui ~ I for all i. In [37]. we gave a sufficient condition for this to 
happen. 

Proposition 4-3. — (^[37], Theoreme 3.2) The two following propositions are equiv- 
alent 

i) For all [x, y) in F^ there exists h ^ G such that h ■ x ~ y and h ■ y ^ x. 

ii) The representation can he decomposed into r -\-\ distinct <C- irreducible rep- 
resentations and this decomposition can he realized m M (i.e. rij = 1 for all i and the 
representations Wi are realizable in Rj. 

Remark 4.5 : It means that all the representations of are of type 2. Hence 
Sym^ ~ C+i. 

Remark 4.6 : In particular this is true for nested fractals (cf examples, section 1.1.4, 
and [31]). 

As explained in the appendix, when L*^ = pi x • • • x P^ then can be lifted to 
a polynomial map on C^'''"*"^-' and the matrix of degrees is equal to the degrees of the 
polynomials involved in this map. In the example of the Sierpinski gasket we will use 
this polynomial representation to compute the map g and analyze its dynamics. 
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4.2.3. Proof of proposition (4.2). — The proof of the proposition rely on the 
following lemma. 

Lemma 4- 2. — For any n the matrix dn is primitive. More precisely, for any n and 
any j = 0, . . . , r, dnj.o > and dn.o.j > 0. 

N.B.: Primitive means that there exists a power with positive coefficients. Here, 
we see that ((i„)^ has positive coefficients. 

Suppose this lemma proved then the proof of proposition (4.2) runs very much like in 
the simpler case L*^ = L'^L Let us ffist prove that {So} has non-negative coordinates 
in the basis ({i^o}, • ■ • ijt'r})- This is a direct consequence of the fact that Sq is a 
Kahler form, as the restriction of the Fubini-Study form to L*^ (cf appendix A. 5). 
Indeed the real 

is called the mass of Vi and is a positive real when 5*0 is Kahler. Thus if {Sq} = 
J2i'^i{^i} then 

f cdimL'^ 
r . c-dimLG-l ' 

and Jj^a Sq^™^ is positive. (Actually, the coefficients q are even integral, since Sq is 
an integral class, cf [6], section 6.4.2, iii)). 
Then Equation (71) reads as follows: 

7V"{5o} = d„{5o} + {[A.]}, 

where {Sq} and { [D^]} are considered as vectors of coordinates in the basis ({fo}, ■ ■ • {i^r})- 
Denote by In the largest eigenvalue of the non- negative matrix c?„. Suppose that 
Dno 7^ 0, the primitivity of dno immediately implies that Ing < A^"". Indeed, (d„(,)^ 
has positive coefficients, thus 

(^"" - dnMASo}) = «)'((A^"° - O{^o}) 

has positive coefficients which implies that < A^"°, cf proof of theorem 1.1 of [43]). 
Thus, since d„ is submultiplicative (cf proposition (A. 6)) we have lim„^oo -j^ig")* Sq = 
0. □ 

At any point x G L'-^ the tangent space Tx(L'^) is isomorphic to Sym'^(V^^) x • • • x 
Sym'^(y,.'^). Therefore, at any point x eh^ \ Ig^ where g" is smooth the dilferential 
dg'^{x) of (/" can be decomposed into blocks 

(77) Bl^{x) : SyuP{V^)^SyiT,''{V^), 0<i,j<r. 

We first prove the following lemma. 

Lemma 4-3. — The coefficient dn,i.j is positive if there exists x in L*^ \ Ign such 
that Bl^{x)^Q. 
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Proof: Let us first remark that when L'-^ ~ x • • • x this lemma is trivial. 
Indeed, in this case the map g" can be represented in homogeneous coordinates by 

(78) g{[xo ■.yo],...,[xr: Vr]) = {[Pi' : Q'^], ■ ■ ■ AK' ■ Qr]) 

where Pp{xo,yo, . . . ,Xr,yr) and (5"(xo, yo, ■ ■ ■ , Xr,yr) are homogeneous polynomials 
of same degree in the variables {xj, yj) (and Pi and Qi are prime). As explained in the 
appendix, the degree of (P", Q") in the variables {xj^yj) is equal to dn,i,j- Therefore 
dn,i,j > means that P" and are not constant in {xj,yj) and therefore that B"^ 
is not the constant 0. 

Let us now prove the lemma in the general case. The volume of Ci, i'f^™'~\ is 
positive and we set 

Remark that if a; is a closed current of bidegree (1,1) and a a smooth closed form 
of bidimension (1,1), then /^g A a depends only on the cohomology class of uj. 
Therefore if is a closed current of bidegree (1,1) with cohomology class {cu} = 
co{i^o} + • • • Cr{vr}, then 

(79) / wAi^o^""^" A--- Ai^f^^'-i A--- A^^™^" =Cc,;. 
Applying this formula to (g")*^'j we get 

Cdn ^J= f (g")V, A 4"''^" A • • • A i.f '"^--i A • • • A uf"'^'-. 

Since {g"')*Vj is a positive closed (1,1) current it does not charge the analytic subset 
of codimension bigger than 1. Thus, we have: 

(80) Cdn j (ff") V, A 1^^""^° A • • • A "^'-1 A • • • A i/f 

As explained in the appendix the current, [g^Yvj is smooth on L'^ \ /(.g") and we 
can write at any point x € L*^ \ Ign 

(81) (5")V, A i/q^™^" a • • • a vf^'^'-^ A • • • A vf^^^^ix) ^ elj{x)v{x), 

where e"^ {x) is a smooth positive function on L'^ \ Ign and v the volume form v = 
^dim£o /\ . . . /\ ;ydim£,^ p^.^^^ ^-^^^ > it is euough to prove that efjix) > 

for at least one point x in L*^ \ Ign . Let a; ~ (xq, . . . ,Xr) be in L*^ \ Ign and set 
g^(x) = w = {wo, • • ■ , Wr). We denote by Bci{x, e) the ball of Ci with center x and 
radius e. We choose e and e such that g"{Bco{xo, e) x • • • x Bc^{xr,e-)) C Bcoiwo^e) x 
• • • X Bc^ (wr , e) , and holomorphic coordinates z| , . . . , z^j^^^ ^ . and , . . . , z^^^^ £ . on 
Bcii^iT^) and Bci{wi,e). If the Kahler form i^j has locally a psh potential Uj on 
i?£^ (uij, e) then we can write 

r dim£( dim£,/ 

(82) (5")V,= 5] ^ ^ Cii,*dziAdzi'„ 

ij'=0 fc=l k' = l 
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where 



fc''<dim Cj^/ 

1 ~ J -V 



(83) = {BrAz))[ .4 (g"(z)) 

where we wrote BJ^j{z) for the matrix of the block differential _B"^ at the point z, for 

the local coordinates and (5^)- Since are kahler forms on £i we can find c > 
such that 

dim Ci 

i>i> c A (izjj., 

fc=i 

on B{xi,e). This implies that 

(g") V, A A • • • A '"^-1 A • • • A z.f-^- > (J] CL,)^U^t"l^'c(^d4 A d4)- 

k 

Thus e"^(x) = implies that J2k ^k\(^) = but the matrix (C^'^j,, {x))k,k' is positive 



so this implies that the matrix (C'^'^z is null. From formula (83), and since 



the matrix ^ g^j^^ij (g"(3^))J is of maximal rank, since vj is a Kahler form, we have 

Proof of lemma (4.2). We know that the map Q Tr(cxprjQrj) defines an embed- 
ding of Sym into L*^. On Sym the map g is given by the map T (cf proposition 
(3.f )). Firstly, we compute the differential dT at a point Q where Q is real and posi- 
tive definite. For / in 'R^ wc denote by Hqlf) the harmonic prolongation of / with 
respect to Q<i>. Wc can easily see from formula (2f ) that the differential cLTq of T 
at the point Q satisfies: 

(84) < dTQ{Y){,f)J >=< Y<MHQ{.f)).HQ{.f) >, 

for any Y in Sym*^. At the point Q = Id the harmonic prolongation H^(]^{f) equals / 
where: 

/ on (9F<i> 
on F<i> \ aF<i> 

We want to prove that d„.jfl > and d„.oj > 0. From lemma (4.3) it is enough 
to prove that i?oj(Id) and Bjfi{ld) are non-null. Let us prove that Boj{ld) ^ 0. We 
choose a convenient Y in Sym*^(Vb): we choose Y = pvo, the projection on the sub- 
space Vb for the decomposition (74). The projection on the component Sym'^(V,) 
of (iTji^(pvb) is just given by the restriction to the subspace Vj. To prove that 
Boj{ld) 7^ it is enough to find / in Vj such that 

</,rf7ld(pvo)(/) >>0. 



/ 



4.3. ASYMPTOTIC DEGREE OF g". 63 



But 

< LdTi^{pvo){I) > = ^a-^ < i^F<i>,,,PVoMi>.x 

and /|F<i> = ^x{z)f{x) where 5x is the Dirac function at the point x. Thus the 
last term equals, since pvb is an orthogonal projector, 

xeF 

Since Wq is the trivial representation of G, the subspace Vq is the subspace of functions 
invariant by G. Thus < PVo^xtPVq^x > > for all x in F. (Indeed, the function 
\U\ SgGG ^s -'^'-"^ '^^^^ ^^'^ contained in Vq. This implies that 5x cannot be in the 
orthogonal complement of Vq.) This implies that the block 0, j of the matrix rfTjj is 
non-null, i.e. that Sqj (Id) is non-null. 

To prove that _Bj.o(Id) is non-null we proceed similarly. We consider Y = py,. and 
/ = 1 e Vq. We have: 

< l,drjd(pyj(l) >= < 5x,pv,{5x) > ■ 

x£F 

But < pvj{5x):5x > cannot be null for all x since {5x)xeF generates the space M^. □ 

4.3. Asymptotic degree of g". 

We denote by In the maximal eigenvalue of dn- Using the submultiplicativity of 
dn we set 

(85) doo = lim (/„)". 

n — »oo 

N.B.: In the publication, we made a mistake and wrote doo = ^logZ„, which must 
obviously be log d^o ■ 

Considering formula (73) we sec that doo < N . If we denote by \\dn\\ the Loo norm of 
dn, i.e. \\dn\\ = supj X]j=o('^")ij : "^"^ ^^^.n easily check that 

(86) doo = lim 

n — ^oo 

(Indeed, classically \\dn\\ > In and for all no we can find a constant K > such that 
for allp > and /c = . . . n— 1, ||d„op_|_^.|| < ||(d„Q)Pd/j|j < /ir(Z„„)P, which immediately 
gives the other inequality lim |ld,i|l " < doo)- 

Proposition 4-4- — ">■) o,"""^ *^ ih,e case i) of theorem (4-1) if and only if doo < 
a) In the lattice case for all choice of [A, b) 

(87) log doo > lim sup - log |i/^„> - u^^^ \ , 

n — 'oo ri 

where |i'<n> ~ ^<n>\ total mass of the measure. Furthermore, for a generic 

choice of {A, b) we have the equality 

1 



(88) log doo = iim_, 3 log 1 1/±„> - \ . 



n — >oo 77, 
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Proof: i) Indeed, we remarked in the proof of proposition (4.2) that I?„ 7^ is 
equivalent to In < N"-. 

ii) Let be the analytic subsets defined by 

V- = {X e TT^H'^^), <X,1>^ 0}, 
V+ ^{Xe 7r-\h^), < X, n^eFV.Vx >= 0}. 

Proceeding exactly as in proposition (4.1) we know that dd'^\n\ < > | is a 

potential for {g'")*[V^] + [£>„] (and idem for < R'^ ,IIx^fVxVx > and V^}. Hence, by 
proposition (3.2) we have 

(89) :.±„> = (7ro0)*((g")*[y±] + [D„]), 

where (tt o </))* is the pull-back of tt o as defined in appendix A. 6. By proposition 
(3.2) we know that the N-D spectrum corresponds to the zeroes of i?" and we deduce 

(90) '^^n>-^<n><{^OC^nig-y[V^]), 

with equality when (/)(A) does not meet the indeterminacy points of 17" (which is the 
case for a generic choice of {A, b), as seen in the proof of theorem (4.1)). The map (j) 
can be extended into a holomorphic function on by setting (f){oo) — 7r(exp (77/677)). 
Remark that 4>{oo) does not belong to or , so that formula (89) and (90) 
remain valid when (tt o (/>)* is the pull-back of the extension of tt o to P^. In P^ the 
cohomology class of a positive (1, l)-current (i.e. a positive measure) corresponds to 
its total mass, more precisely, we have {v} ~ \i>\{So} where i/ is a positive measure 
and its integral on P^. One can easily check that the coordinates of the linear map 
(tt o 0)* : iJi'i(L'^) i/i'i(pi) in the basis {{i^a}, {vr}) and {da} are positive as 
well as the coordinates of {[T^*]} in the basis ({I'o}, ■ • ■ , {I'r})- Considering equation 
(90) in homology we get 

W<n>-'^<n>\<i^OcbndA[V^]}), 

with equality for a generic choice of {A, h). Thus we have 

\^tn>^^<n>\<\\{^-^T\\ \\dn\\ 

where ||7rot/))*|| and \\dn\\ are the L°° matrix norm and ||{[^*]}|| the L°° norm of the 
vector {[1^*]}. Thus (87) easily follows form (86). On the other hand, since {[1^^]} 
and (tt o (/))* have positive coordinates we can find K > such that |i^<„> — v^n> \ > 
if ||d„|j when equality in (90) is satisfied. Thus, for a generic choice of {A, b), equality 
(88) is satisfied. □ 

4.4. Regularity of the density of states 

We first state a conjecture and show how it can be related to results on Lelong 
numbers of the Green current. 

Conjecture 4-1- — The measure ji — ji^^ is continuous, i.e. it does not charge any 
point. 
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Wc introduce the notion of Lelong numbers of a psh function. Let u be a psh 
function in a neighborhood U C C" of 0. Then the Lelong number of u at is defined 
by 

iy{u,0) = max{c > s.t. u{z) < clog||2|| + 0(1)}. 

The Lelong number of a positive closed (1, 1) current T is defined by v{T^p) ~ i/lu^p) 
for any local psh potential u oi T, T ~ d(Fu. On C it is easy to sec that the Lelong 
number at p of a positive closed (1, 1) current (i.e. a positive measure) is the mass of 
the point p. 

Coming back to our situation, we suppose that we are in the lattice case and 
that doo — N (otherwise /i — //^^ = 0). We remark that the Lelong number of 
dd'^ In o 011 at A is the order of vanishing ord(i?" o 0, A). By proposition (2.3), ii), 
we know that this order of vanishing is equal to i^^,(^({A}). Hence, we see that the 
conjecture is equivalent to 

lim — i^(d(i= In ||i?"o 011, A) = j/(dd=G o 0, A). 

Since the current S — dd'^G is the limit of the sequence of currents -^Sn with po- 
tential ■j^dd'^ In the question is equivalent to know whether the limit of the 
Lelong numbers of the restriction of the currents 5'„ to a curve is equal to the Lelong 
numbers of the restriction of the limit S. There is, at the present time, only one result 
on Lelong numbers of Green currents: it says, cf [13] theorem 2.4.6, that the Lelong 
numbers of the Green current are null on the complement of the indeterminacy points 
of the iterates: with our notations it means that the Lelong number of S is null when 
the Lelong numbers of the Sn are null. Unfortunately, it cannot be applied easily 
to our case. Firstly, because it does not state that the Lelong numbers of S is the 
limit of the Lelong numbers of -^Sn at any point, and secondly, because we need 
information on the restriction of the Green current of S to the curve 0(A) , which can 
be strictly bigger than the Lelong number of S. Nevertheless, it could certainly be 
possible, with a little more work, to prove a result in the generic case, but we prefer 
to leave the general result as a conjecture. 

The following result gives a criterion for the regularity in a much stronger sense. 

Proposition 4-5. — When doc — N, the integrated density of states fJ,{X) ~ J\ dii 
is locally holder continuous on the set of A 's such that there exist open subsets [/ C C 
and V ClL^ such that A G U, U^^^/gn c V and g" o 4>{U) nV ^(b for all n. 

N.B.: By locally Holder continuous we mean that for any relatively compact open set 
[/ C C, we can find ao > and C > such that |^(A) - m(A')| < C|A - A'|"« on U. 
Proof: By proposition VL3.9 of [8] we know that the Holder regularity of ^(A) is 
equivalent to the Holder regularity of Go 0(A). Thus the result is a direct adaptation 
of Theorem 7.1 of [45] (cf appendix, theorem (A.l) iii)) which states that the Green 
function is locally Holder continuous in the set of normal points: a careful reading 
of the proof shows that it can be straightforwardly modified to prove the Holder 
regularity of G o under the milder conditions of proposition (4.5). □ 
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4.5. Some related rational maps. 

As explained in the introduction, the map g defined on the projective variety L*^ 
is from the theoretical point of view the best-suited to our problem, but from the 
computational point of view it is not easy to handle. In this section we introduce 
related rational maps defined on projective spaces. The map g we introduce is the 
map considered in the initial work of Rammal in the case of the Sierpinski gasket, cf 
[34], as well as in previous work of the author, cf [38]. 

The map T is 1-homogeneous, hence it can be written 

(91) T=-, 

P 

where R : Sym*^ — > Sym*^ is a homogeneous polynomial map and p a homogeneous 
polynomial, prime with R. We define R : Sym*^ x C ^ Sym*^ x C by 

R{Q,z)^{R{Q),p{Q)z). 

The map R has no common factor and induces a rational map g on pdimSym ^ -y^g 
denote by dn the degree of the iterate 5" (cf appendix B). 

Lemma 4-4- — The map g is hirationally equivalent to the map g, i.e. there exists 
a rational map h : pdimS'j/m _^ j^G analytic subsets E C L*^ and E C 

pdim Sym codimension at least 1, such that h is a biholomorphism from P'^"" Sym \^ 
E onto L*^ \ E and such that 

g = h o g o h~^ . 

Proof: This is clear from formula ((46) since given by h{Q) ~ 

'!r{exp {rjQr])) is biholomorphic from Sym*^ onto Tr{X S 7r^^(L*^), < X,l >= 0}. 
Hence, the map g and g extends the map T to 2 different compactifications of Sym*^. 

□ 

Using the 1-homogeneity of T, one can introduce a rational map on pdimSym -1 
which contains most of the information on g. Precisely, for all n one can write 

R — hjiRji^ 

for a homogeneous polynomial map i?„ with no common factor and a homogeneous 
polynomial /i„. This induces a map g" on pdimSym -1 .^^j^j^ degree d^ ~ degrcc(/i„). 
Set 

doc = lim d^ , doo = lim , 

n — *oo n — »oo 

which are well-defined thanks to the subadditivity of Indn and Indn- 
Remark 4.7 : As we shall see in the examples, the map g is the renormalization 
map that was previously considered, for example, in [34], [20], [38]. The map g is 
1-dimensional when the space Sym*^ is of dimension 2. Hence, the property of spectral 
decimation is related to the fact that dimSym*^ ~ 2. 

Proposition 4- 6. — We have the equality d^o — d^o — d^o. 



4.5. SOME RELATED RATIONAL MAPS. 



67 



Proof: To prove that d^o ~ doo wc proceed as in [12]: wc can write in homology 
(5")* = h^,{g^'-)*h* and (5")* = /i*((7")*/i*. If |||| denotes the norm then we have 
\\dn\\ < c'n 11^* II 11^1*11, from which we get doc < doo (N.B: note that d„ is a scalar, i.e. 
d-n = l|c^n||)- Conversely, d„ < ||/i*||||/i*||||d„||, from which we deduce doo < rfoo- 
To prove that doo = doo we write 

R"{Q,z) = (i?"(g),poi?«-i(Q)...p(Q)z) 

= (/i„i?„, (n^-Q^/if SreeW^Q)^ . . ■p{Q)z). 

But /idegree(p)+i ^j^j^gg (3^^^^,^ degree(i?) = degree(p) + 1), thus n^-J /jdegree(p) 
divides and dn < degree(p)((i„_i + • • • di + 1) + 1. It immediately follows that 

doQ — doQ . n 

Remark that from the proof we see that R is algebraically stable if and only if 
degree(/i„) = for all n and that in this case G{Q, z) = G{Q) if G and G are the 
Green functions of respectively R and i?. But this result is not really useful since 
in general the maps g and g are not algebraically stable. To convince the reader 
of this fact we explicitly compute the degrees c?„ when doo = N. Set P^n>{Q) = 
det(((5<n>)|_F<„>\a_F.,„> )• We claim that when doo = N (i.e. when we are in the case 
ii) of theorem (4.1)) then 

R'^iQ.z) = (p<„>(Q)r"(Q),p-„>(Q)z). 

Indeed, we know from formula (46) that p<„> simplifies the singularities of T", and 
we know from the same formula that p<„> and p<„>r" cannot have a common factor 
because otherwise it would imply that i?" is null on a hypersurface of L*^, which is 
impossible since we are in case ii) of theorem (4.1). Thus, 

dn = degree(p<„>) + 1 

iV" - 1 

= |F<„> \ aF<„>| + 1 - ^^-^|F<i> \ ai^<i>| + 1. 

So, we remark that dn grows like aN'"' + h for some a and b. In particular, we see that 
dn cannot be equal to = except in the case where N -- 1 = |F<i> \ 9i^<i>|. 
In general it is not the case. However, in the example of the interval we have N ^ 2 
and |F<i> \ 9F<i>| = 1 so there is a priori no incompatibility between doo = N 
and the algebraic stability of g and g. As we shall see, in this particular case R 
and R are indeed algebraically stable with degree 2 and one can express the density 
of states in terms of the Green function G (this was shown directly in [38]). But 
this is an exceptional situation: indeed, it is not difficult to see that the equality 
N — 1 = |F<i> \ 5-F<i>| can occur only when the lattice is based on the unit interval 
of M, i.e. when we are, up to isomorphism, in the following situation: the self-similar 
set X is the interval [0, 1] and 4'i([0, 1]), . . . , *Ar([0, 1]) are N subintervals of [0, 1]. 
Remark 4.8 : From the formula we derived for d„, we see that the map g is not 
algebraically stable (and none of its iterates is) in the case N = doo , at the exception 
of the unit interval (indeed, otherwise d„ would be equal to after a certain level). 
This means that there is no natural way to define a non degenerate Green current 
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associated with R and g. This clearly confirms the essential role played by the map g 
defined on the algebraic subvariety L'-^. It is quite interesting to note that this is very 
coherent with the general philosophy that seems to emerge in the study of iteration 
of rational map which is roughly that when a map is not algebraically stable then one 
must seek for a birational transformation that makes it algebraically stable (cf [12], 
theorem 0.1, where a result in this direction is proved for a particular case). In our 
case, the birational transformation has some "physical" meaning, since the complex 
Lagrangian Grassmanian is known to be a natural compactification of the space of 
complex symmetric matrices (cf for example, [9]). 



CHAPITRE 5 



EXAMPLES 



5.1. The Sierpinski Gasket 

The maps T and g 

For the Sierpinski Gasket the group of symmetries is G = 6*3 and C''^ can be de- 
composed into a sum of 2 irreducible representations = Wq Wi , where Wq is 
the subspace of constant functions and Wi its orthogonal complement (for the usual 
scalar product on C^). Hence, any Q in Sym can be written 

(92) Q = uopiwo + UiP\Wi ' 

where (mq, mi) are in and p\Wo ^^'^ P\Wi ^-re the orthogonal projections on Wq and 
Wi respectively. We denote by Q""'"^ the element (92) and we have Sym*^ ~ C^. 
As in section 4.2.2, L"^ - x P^. A point in x P^ will be represented in homoge- 
neous coordinates by 



We denote by tt x tt : (C*)^ x (C*)^ ^ P^ x P^ the canonical projection. The space 
Sym*^ is embedded in P^ x by the injection ^ {[uq : 1], [ui : 1]). 

An easy computation shows that with the isomorphism Sym*^ ^ the map T is 
given by 



(K : vo], [ui ■■ vi]). 



(93) 




Thus, in homogeneous coordinates the maps g is given by 
g {[uq ■■ Wo], [ui : vi]) 



(94) = ([3uoUi : 2uoUi -1- uiVq], [3mi(moWi + uiVq) : buiVoVi + uovf]) . 

The matrix of degrees is 



(95) 




The map g on P'^ 

As shown in section 4.4 the 1-homogencity of T naturally induces a map on P^. 
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Indeed, if we set z = ^ and z = ^ where (mq, ui) — T{uo, ui) then we have z = g{z) 
where 

(96) g{z) = 



(2z + l)(z + l)' 
In homogeneous coordinates in P^, we see that g is given by 
(97) g{[z(i : zi\) = [zo(5zi + z^) : (2zo + zi){zo + zi)] 

(i.e., in (96), g is given in coordinates [z, 1]). More formaUy, if we denote by s the 
rational map s : P^ x P^ ^ P^ given by 

s([uo : Wo], [ui ■■ vi]) = [uqVi : uiVq] 

then the following diagram is commutative 

pi X pi — § — > pi X pi 



We set = s-^{{z}) for z in P^. We see that 

g{C,) C 

Remark 5.1 : At this point we already know, by proposition (4.6), that the asymp- 
totic degree doo is equal to the degree of g, i.e is equal to 2. So we know that we 
are in case ii) of theorem (4.1), thus that we have = /i and that for almost all 
blow-up the spectrum is pure point with compactly supported eigenfunctions. 

The map R 

At this point we are not yet in a position to describe the current Sn- Indeed, we com- 
puted the map g on L*^ but not the map R on 7r~i(L'^) (and to describe the sequence 
of currents Sn we need to compute the map g and the hypersurface Di of zeroes of 
R). In general, it is not easy to compute the map R on A, since A has quite large 
dimension. To overcome this difficulty we will lift the restriction of R to n~^(L^) 
to a polynomial map on x C^. We first describe more precisely the isomorphism 
L'' ~ pi X pi. Let t/jQ be an orthonormal vector of Wq and ■01, V'l be an orthonormal 
basis of Wi . We consider the homogeneous polynomial map s : x ^ ^ given 

by 

S {{uq, Vo), (Ul, Wi)) = (fO + UO'0O^O)(W1 + Ui7/'i'0i)(di + ui-0i-0i). 

We see that 

s {{uo, 1), (ui, 1)) = exp(uo'0'oV'o + ui(i/'ii/'i + '^iV''i)) = exp TyQ""'"!??, 
and that s is (1,2) homogeneous, i.e. that 

s {f3{uo, Vo), f3'{ui,vi)) = (3{P'fs {{uq, vq), (wi, f i)) . 
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Hence, the map s takes values in tt ^{L,^) and the isomorphism L*^ ~ x is 
represented by the commutation of the foUowing diagram 

(C2)* X (C^)* pi X pi 

Remind from formula (46) that 

R{exp{r]Q7j)) = det((Q<i>)|j.^^^\gi.^^^ ) exp(77rQ77). 
An easy computation gives 

By homogeneity, we get 

R{s{{uo, vo), {ui,v,))) = {vovlfR{s{{^, 1), 1)). 

vo vi 

Hence, we see that 

< R{s ((mo, Vo), (ui, wi))), 1 >= Avf{2uQVi + uiVa){uoVi + 5uiUo)^, 
and that the value of R{s ((uo, wo), {ui, vi))) on the monomials of degree 1 of ^ is 

12uoUivl{uoVi + 5uiVo)'^ {rjP\WoV) 
+12uivf{uovi + viuo){2uovi + uivo)iuovi + buivo) {vPlWiV) ■ 

Thus, if we denote by i? : x ^ x the homo geneous polynomial map given 
by (we adopt the same notation for this map and for the map on A, since they are 
different representations of the same map) 

R{{uo,vq), {ui,vi)) 

(98) = {{3uoUiVi,2uovl + wouiwi), (6-ui(itoVi + uiVo),2(5uiVoVi + uqvI))) , 
then we see that the following diagram commutes 

C2 X C2 C2 X C2 

^-1(LG)U{0} — ^ ^-i(L«)U{0} 

(Indeed, by the previous computation we see that R{s{{uo, vq), (ui, vi))) and s{R{{uq, vq), {ui,vi))) 
coincide on the unit 1 of and on the monomials of degree 1 of A. Since they are 
also elements of 7r^i(L'^) U {0} they are equal.) 

Remark 5.2 : This means that we are able to lift the map R on 7r^i(L'^) U {0} to a 
polynomial map on x C^. This will be useful for computation. It is clear that it 
would be possible to do the same thing when L*-^ is a product of pi, i.e. for example, 
in the case of nested fractals. 
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Hence, we see that in x the analytic set Di is given by Di = tt x tt{vi = 
0} = Pi X [1,0]. Thanks to (98) we will be able to describe 5„ and S. Indeed 
||s((uo, ^0)7 {ui, = (uq + Vq){ui + I'l)'^, thus 5*0 is the current with potential 

lni|(uo,i^o)|| +21n||(ui,ui)|| 

on xC^ (i.e. this means that we have (7rX7r)*S'o = dd'^ In || {uq, vo)\\+2dd'^ In \\ (iti, 

In particular, we remark that {Sq} = ^ 2 ^ ^^"^ canonical basis of H^'^(P^ x P^). 

Since {[£*!]} ~ ^ ^ ^'^^^ equation (71) is indeed verified for n = 1. The 

current S'„ will be defined by its potential on C^xC^, In || (i?")o|| +2 In j| (i?")i j| where 
(i?")o and (i?")i the coordinates of i?" on the first and second components of 

C2 X C\ 

The Green current S 

We are now in a position to describe the iterates i?" and the currents Sn- We set 
zq = uqVi, z\ = uiVq. We remark that equation (98) can be rewritten 

R{iuo,vo), {ui,vi)) = iiuiPi{zo, zi),viP2{zo, zi)), {uiP^izo, zi),viP4{zo, zi))) , 

where 

Pi(zo, zi) = 3zo, P2{za, zi) = 2zo + zi, 

Psizo, zi) = 6(2:0 + zi), Piizo, zi) = 2{zq + 5zi). 

We define R by 

R{zo,zi) = {Pi{zo, zi)P4{zo, zi), P2{za, zi)P3{zo, zi)). 
Note that i? is a lift on of g. For all fc > we set 

P3,k^P3P3°R---P3°R\ 

P4,k = P4P4 o R - ■ ■ P40 R''. 
An easy computation shows 

i?"((uo,«o),("i,^'i)) = iuiVif"~"iqz^iuiViP3,kP4^kf"~'"' 

We remark that ^3(^0, zi) and Pa^zq, zi) are null respectively on C_i and C_5, thus 
we have 

on-l _ 1 

[Dn] > 3 {[ui ^ 0] + [vi ^ 0]) 

on— fc— 2 -1 / 

+E3^^-^ E [^^]+ E [^^] 

k—O \z.g^z— — l z.g^ z—~5 
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Since S = lim„^oo grrS'n we see that 



1 °o o-fc-l / 

(99)5>-([ui=0] + K=0]) + ^^- [^~']+ E 

To prove that there is actuaUy equahty in the last formula it is enough to check that 
there is equality in homology. It is easy if we remark that {5} = {5*0} = ^ ^ ^ and 

{[C'x]} ^ ^ J ^' Finally we sum-up our results in the next theorem 

Theorem 5.1. — For the Sierpinski gasket we are in the case ii) of theorem (4-1)- 
The asymptotic degree is 2 and the Green current S is given by the right hand term 
of (99). 

,ND 



Description of pL = pL in the discrete case 

J _ 

l — Z U-i—Uq 



It is useful to make the change of variable v = = in (96). With this change 



of variable g is conjugated to the polynomial 
(100) p{v) =v{b + 2v). 

Remark 5.3 : This polynomial is, up to a change of variable the polynomial that 
appears in the initial work of Rammal. [34]. and in subsequent works. [19], [49]. 

With the choice made in section 1.2.3 we see that the coordinates of A are (0,3) 
in ~ Sym*^. We take for h the uniform measure on F. In L'' ~ P-^ x P^, tt{<I>{X)) 
has homogeneous coordinates ([A : 1], [3 + A : 1]), which means that in coordinates v 
it corresponds to v{\) = — A. Applying theorem (3.1) and theorem (5.1) we 

get 

Theorem 5.2. — For the Sierpinski gasket in the discrete case we have 

fc=0 



M-^"" = ^^-3+E^ E E 



One can remark that [— | , 0] is backward invariant by p, hence the Julia set J oip 
is included in [— |, 0] and it is not difficult to see that ^7 is a Cantor subset of [— |, 0]. 
Since p(— |) = we remark that — | is in the Julia set of p, hence the Dirac masses 
obtained by preimages of — | are accumulating points of p. Iterating p we see that 
— I is in the Fatou set of p and hence the Dirac masses at the preimages of — | are 
isolated in p. The point —3 is in the complement of the Julia set and hence is an 
isolated mass in \x. 



5.2. The unit interval 



We will show that for this particular case, the density of states can be expressed 
thanks to a rational map simpler than the map g, namely we express the density of 
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states in terms of the Green current of g, defined on P^, which has been introduced in 
section 4.5. This relates the present work with our previous work [38]. But firstly, we 
illustrate some of the notions we introduced in the text by an explicit computation 
of the map R on this example. 

In this case, F ~ {0, 1} and G is the trivial group so Sym*^ ~ Sym^ can be 
identified with C'^: Q in Sym^ is represented by the point of coordinates (a, d, g) if 

In the Grassmann algebra generated by {^q, 770, ?7i, '7i} we have: 

(101)exp(^(577) = 1 + a?/o77o + (ir\im + f?(%?7i +^i'7o) + (ad - (?^)%77o^i77i. 

Since G is the trivial group L'-^ = and from the last formula we easily deduce that 

(111)= 7r{Zl + a?7of7o + (i??!??! + g(%??i + + -Dr/oWi??!, ad - = DZ}. 

We set 6 = jz-^- An easy computation shows that 

R{Z1 + ar]„i]Q + drj^i]! + qirjar]! + rj^ijo) + DrjQijQrj^iji) 
(103) = Zl + ar/gT^o + dViVi + q{VqVi + ViVo) + -D%??o?Ji?7i, 

where 

Z = 5{a + S-^d)Z, D = S^(a + 5-^d)D, 
h^6{a^ +S-^DZ), d = 6{d'^ +6DZ), 
q = -Sq^ 

On 7r~'^(L'^), considering formula (102), we see that d and d are also equal to 

d = S{a{a + S-^d) - S'^^), d = S{Sd{a + S'^d) - 6q^). 

It is then clear that 

7r{i?" = 0} n = n Uk=in{a''a + (1 - a)''d = 0, g = 0}. 

(hence the zeroes of i?" are of codimension 2 in L^, so -D„ = for all n and we are in 
case ii) of theorem (4.1)). 

In the lattice case we can easily describe the function (/)(A). Indeed, A is the usual 
discrete Laplace operator with coordinates (a = 1,0? = l,q = —1). If 6 is the 
measure that gives weights mo and mi to the points and 1 then we see that 
(f>{X) = exp(^(A + XIb)ri) is a point of the form (101) with a = 1 + Amg, d = 1 + Ami 
and q = —1. In particular we see that 0(A) does not meet the zeroes of i?" so that 
^ND _ Q (actually, it is very easy to see directly that there cannot be any Neumann- 
Dirichlct eigenfunction for this 1-dimensional Laplace operator). 

The maps T and g 

For this example the easiest way to describe the density of states is to consider the 
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simpler map g introduced in section 4.5. A simple computation or an application of 
formula (103) gives in coordinates (a,d,q): 

T(a, d, q) = \^Aa(a + - 5-^q^,5d{a + 5-^d) - 6q^ , -q^). 

a + ^d 

Set p{Q) = det(((5<i>)|i?^j^\ai?^j^ ) = 5{a + 5^^d). As in section 4.5. we define the 
map i? : C'^ ^ obtained from T by simplifying the singularities: 

R{Q) = P{Q)TQ 

= 5{a{a + 5-^d) - S-\^,Sd{a + S-^d) - Sq"^, -q^). 

We denote by g the rational map on induced by R. The map g has a simple 
indeterminacy point [1, —6, 0] and we easily see that g is algebraically stable (cf [38], 
for more details). We denote by G the Green function G = lim„^oo ^rr log In 
the lattice case we set (/)(A) ~ A — Xlb and in the continuous case 0(A) — ^(a)- 

Theorem 5.3. — In the lattice case 

fi^^AGo$. 

In the continuous case the same formula holds on the ball B{0, 

Remark 5.4 : This result was proved directly in theorem 3.1 of [38]. As shown 
in [38], this formula is related to the classical Thouless formula, and we can relate 
the Green function Go cf) with the Lyapounov exponent of the propagator of the PDE 
associated with our second order differential operator. In [38] we used this formula to 
prove that the density of states is continuous and supported by a Cantor subset of M 
for ct ^ (for a = ^ we are in the situation of the classical Laplacian and everything 
is well-known). We also proved the Holder regularity of n for some values of the 
parameter a. In [41] we go further and describe the spectral type of the operator, 
depending on a and on the blow-up w. 

Proof: Thanks to the expressions of R and R we can easily deduce that G{Q) < 
G{exprjQrj) for any Q in Sym^?. On the other hand for Q in S+ we know that (cf 
lemma (3.3)) 

G(exp^Q?7) = lim log ] < R" {exprjQij) , 1 > ], 

and by direct computation we see that < i?"(exp^(5?7), 1 >= ^^ZoP°^''iQ)- Hence we 
sec that for any Q in S-t- we have G{Q) > G{cxpriQri). The equality G'o(j()(A) = Go(/)(A) 
is satisfied for A in C \ M, so in Lj^^. Theorem (5.3) is proved. □ 

5.3. Nested fractals 

For nested fractals we shall prove that we are in the case ii) of theorem (4.1). (The 
existence of N-D eigenvalues was proved initially in [3] . The fact that /i^^ ~ was 
proved directly in [39]). Denote by Wq, . . . , Wr, Wr+i, ■ ■ ■ , Wr' the list of irreducible 
representations of the group G, and assume that the representations Wq, . . . , Wr are 
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contained in M^. In [39]. proposition 2.3, wc proved that r' > r, i.e. that there 
exists at least one irreducible representation which is not contained in M.^ . The space 
R^<"> can be decomposed in 

where V<:n>,j is the isotopic representation associated with Wj. It is easy to check 
that for n large enough, l^<„>j ^ for all j (indeed, for n large enough, there is 
at least one point x in F^n> such that g ^ g ■ x is injective; thus K^<"> contains 
the representation K*^ and since the representation M*^ contains at least once each 
irreducible representation, cf [44], we know that V^n>.j 7^ for all j). For Q in Sym*^ 
the operator <5<„> can be decomposed in blocks on y<„>,o, • ■ • , V'<n>,r'- Consider, for 
example, ((5<n>)|y<„> ^, ■ clearly, we have ker(((5<„>)|y^^^ C ker iQ<n>) since 
y<n>y C !'<„>■ Hence i?"(exp 77(577) is vanishing on {det(((3<„>)|y^^^^ ^, ) = 0}, 
which is an analytic set of codimension 1 in Sym*^. This implies that £>„ 7^ and 
that we are in case ii) of theorem (4.1). 

Remark that this implies that doo < N but that wc have no more information on 
the value of doo ■ 
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REMARKS, QUESTIONS AND CONJECTURE. 



The main open problem is to understand the almost sure Lebesgue decomposition 
of the operator i?<oo>- Let us be more precise. Consider a typical blow-up to, in 
particular for which dF^oo> = 0- The Hilbert space I?<oo> can be decomposed into 
three parts Ti.ac'Hsc'Hpp such that the restriction of iJ<oo> to these subspaces is 
respectively absolutely continuous, singular continuous or purely punctual (i.e. this 
means that the spectral measure of any function in these subspaces is resp. abso- 
lutely continuous, singular continuous or purely punctual). The spectrum of -ff<oo> 
and the spectrum of the restriction of -ff<oo> to 'Hac'^sc'^pp are respectively de- 
noted by Eac(w), I]sc(<^)j Spp('-^) (they a priori depend on uj). Proposition 2 of 
[40] states that these sets are almost surely constant in lo, i.e. equal to deterministic 
sets S, Sac, Ssc, for almost all blow-up uj. 

One can be more precise and split the Hilbert space Ti-pp into two parts: the first ,that 
we denote Hnd, is the subspace generated by the Neumann-Dirichlet eigenfunctions, 
i.e. by the eigenfunctions of -ff<oo> with compact support, the second, Ti-pp-, is defined 
as its orthogonal complement in Tipp. We denote by Sjvd and Epp the spectrum of 
the restriction of -ff<oo> to resp. Hnd and Tipp. It is clear that = supp/^^^, 

and we proved in proposition 2 of [40] that Yipp{uj) is also determined almost surely 
in Lo. We also know that E = supp/x from proposition 1 of [40]. In this text we 
showed that /i and can be computed from the Green function of the renormal- 
ization map R and the order of vanishing of R. The natural question is then whether 
it is possible to characterize the other parts of the Lebesgue decomposition of the 
spectrum Eqc, Esc, Epp, Epp in terms of the renormalization map R. We can even ask 
more: in [40], we introduced several measures fi'^'^ ^ fi'^'^ ^ fi^P , fVP which split fj, in sev- 
eral parts corresponding to the different components of the spectrum by E. = supp/i'. 
The question is whether it is possible to compute these measures from some char- 
acteristics of the map R, as we computed fi and /i^^ from its Green function and 
the asymptotic multiplicities of its zeroes. In particular, it would be interesting to 
understand at which condition there may be a pure point component Epp not cre- 
ated by the Neumann-Dirichlet eigenfunctions (i.e. at which conditions there are 
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eigenfunctions which arc not generated by compactly supported cigenfunctions). But 
all these questions seem to be very difficult. 

Let us now make few remarks and a conjecture. When N > doo we know that 
the spectrum is pure point with compactly supported eigenfunctions, i.e. that S^c = 
Ssc ~ i^pp ~ 0- Consider now the case where N = d^o- We showed in this text that 
the N-D spectrum is related to the zeroes of i?, i.e. to the indeterminacy points of g. 
Considering that eigenfunctions of -ff<oo> which are not with compact support are in 
some sense approximated by functions with compact support which are not far from 
being eigenfunctions we can ask the following very imprecise question: does the exis- 
tence of a pure point component in the spectrum different from the N-D component, 
i.e. Yipp ^ imply that the iterates of g on (/)(A) approach the indeterminacy points, 
in a sense to be made precise. This leads to propose the following conjecture. 

Conjecture 6.1. — Consider the case d^o = N. Assume that the condition of propo- 
sition 4-5 is satisfied for all A G R, i.e. that for any A € M there exists two open subsets 
U CC and V Ch^ such that XeU, \Jn=Jg^ C V and g"{(j){U)) HV ^0. Is it true 
that in this case Spp = ? 

Remark 6.1 : It is already known from theorem 3.1 that under these conditions 
Ynd = 0. 

One of the main problem is the lack of examples where computations are possible. 
There are very few examples where the spectral type of the operator can be analyzed. 
The case of the Sierpinski gasket is now well understood and computations in this 
example are easy. In this case TV > doo and so the Neumann-Dirichlet eigenfunctions 
are complete. The case of nested fractal is also understood, in this case also > doc- 
We present the spectral analysis of the self-similar Sturm-Liouville operator on the 
real line in [41]. In this case we can prove that Spp = 0. 

But we have no example where Spp 7^ 0, i.e. where there is a pure point component 
not induced by the N-D spectrum. We think it could be interesting to understand the 
following situation (at least by numerical computations), which could be a candidate 
for Epp ^ 0. Consider the Sierpinski gasket and take G = {Id}, the trivial group as 
group of symmetries of the picture. In this case the renormalization map T is defined 
on the bigger space Sym^ of symmetric matrices on F = {1,2,3}. The subvariety 
L*^ is the Lagrangian Grassmanian L^. There is then no reason that N > doo- We 
would bet, on the contrary, that N = doo in this case. The question is the following: 
what happens if we take for the initial operator A<o> and initial measure 6<o> a small 
perturbation of the usual discrete Laplace operator and of the uniform measure? Does 
the spectrum remains pure point or not? 
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For the convenience of the reader we review several notions of pluricomplex analysis 
and pluricomplex dynamics. Our point of view is very partial and only motivated by 
the notions wc need in the main text. The reader is strongly advised to refer to the 
relevant literature for a better understanding. In appendix Al and A2 we introduce 
the notion of plurisubharmonic functions and of currents on complex manifolds. Most 
of the material is taken from the appendix of review texts of Fornacss and Sibony (cf 
[45], [16] and related literature as, for example, [6], [22], [24]). In Bl we give a short 
introduction to basic notions that appear in relation with iteration of rational maps 
of the projective spaces. All the material comes from [45], [16]. In B2 we introduce 
some notions on iteration of meromorphic maps of compact complex manifolds. The 
material comes from works of Favre, Diller-Favre and Guedj-Favre (cf [13], cf [12], 



A. Plurisubharmonic functions and positive currents. 

A.l. Plurisubharmonic functions. — Let 51 be a domain of C™. A function 
/ : il ^ M U {— oo} is said to be plurisubharmonic (rcsp. pluriharmonic) if 

— / is upper-semi continuous, 

— / is not constant equal to — cx), 

— the restriction of / to any complex line is subharmonic (rcsp. harmonic). 
Plurisubharmonic (psh for short) functions are in L^^^ and can be characterized by 
the following property: a function v in Lj^^(f2) is almost surely equal to a psh fimction 
if and only if for all vectors w G C™ 



[14]). 



(104) 




in the sense of distributions, i.e. the first term is a positive measure. 



Examples and basic properties 
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(1) If / is a holomorphic function in fl then log |/| is a psh function. Moreover log |/| 
is pluriharmonic on \ {/ = 0}. 

(2) The function u = log ||z|| is psh in C". 

(3) If (7 : — ^ il' is a holomorphic map between an open subset of C™ to an open 
subset of C™ and if u is psh in fi' then uo g is psh or equal to — oo (note that if g has 
generic maximal rank to' then u o g is not identically — oo). In particular the notion 
of psh functions can be extended to complex manifolds. 

Proposition A.l. — Let Vj be a sequence of psh functions in a domain f2 of . 
Suppose that Vj is uniformly bounded from above in any compact subset of f2, then 

(i) either Vj converges to —oo on compacts or there exists a subsequence Vj^ which 
is convergent in L^j^^^ to a subharmonic function. 

(ii) If V is subharmonic and Vj —^vin L^j^^^ then for any compact K C and any 
continuous function f : 

limsupsup(wj — /) < sup(u — /). 

j^oo K K 

N.B.: This result is a corollary of the same statement for subharmonic functions 
on M" (cf [45]), as psh fimctions on C™ are subharmonic on M^™. 

A. 2. Currents. — We denote by D(p ,j)(ri) the space of C°° differential forms with 
compact support on and of bidegree (p, g), i.e. of the type 

(j) ~ (j)j^jdzj A dzj, 

\i\=p,\J\=q 

where / = (u, . . . , ip), J = (ji, . . . ,jq) and dzj = dzi^ A • • • A dzi^, dzj = dzj-^ A 
•••A dzj^- We denote by D'^p q)i^) the space of currents of bidimension {p,q), i.e. 
the space of continuous linear forms on D^p q-j{n). One can also talk about currents 
of bidegree (to — p,m — q) since a current S can be represented as a (to — p,m — q) 
differential form with distributional coefficients: 

S= Si' ^j'dzji A dzj' . 

\I'\—m—p^\J'\—m—q 

The differential d is defined by duality by 

< dS, (t> >== (-1)p+9+i < S, d4) >, 
or equivalently on coefficients by 

dS = ^ ^ {^^-^dzj + '^^Jj'^ dzj) A dzjf A dzj'. 

It can be decomposed in d — d + d where 

dS ~ — ^ dzj A dzji A dzj', dS = dzj A dzji A dzj'. 

j r,j' ^ j ^ 

We write d!^ — ^{d — d) so that we have dd'^ = x^^- 
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A. 3. Positive currents. — A current of bidimcnsion (p,p) (or bidcgrce (m— p, m— 
p)) is positive if < S*, >> for all cf) of the form 

= iai A cJi A • • • A iup A Sp, 

with Oi e D(^i Qj{Q). A current S of bidegree (1, 1) can be written 

(105) S — Sj^kidzj A dzk, 
and is positive if for any w in C™ the distribution 

Sj.kWjWk 

is a positive measure. 

With formula (104) we see that a function u in Lj^^(n) is almost surely equal to a 
psh function if and only if dd'^u is a positive current. We have the following converse 
result. 

Proposition A. 2. — Let S be a (1, 1) positive closed current on an open ball of<C"^ 
then there exists a psh function u such that S = dd'^u. We say that u is a potential 
ofS. 

Examples and basic properties. 

(i) Let Z be an analytic subset of fl with pure dimension p. Let Reg{Z) be the subset 
of regular points of Z (i.e the subset of points where Z is locally a complex manifold 
of dimension p) . We define [Z] as the current of bidimension {p, p) defined by 

< [Z],0>= / 0, V0ei?(p.p)(17). 

jReg{Z) 

This current is positive of bidimension (p, p) and in fact closed, as shown by Lelong. 

(ii) Let / be a holomorphic function on Q,. We call divisor a formal sum of irreducible 
analytic hypersurfaces of SI. The divisor of / is the divisor ^m.iZi, where the ZiS 
are irreducible analytic hypersurfaces, such that / can be written 

for a holomorphic function g which does not take the value 0, and holomorphic 
functions fi such that Zi = {fi = 0} and fi is a generator of the ideal V{Zi) = 
{/ holomorphic on 51, f{z) = on Zi] (cf for example, [22] section 2.1). Then the 
Lelong-Poincare equation states 

(106) dd^\og\f\=Y,m,[Z,]. 

i 

(iii) All these definitions can be extended to complex manifolds using a local chart. 
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A. 4. Currents of bidegree (1, 1) on P'"". — Let P''' be the complex projective space 
of dimension k and tt : C'^'+^ \ {0} P'' the canonical projection. Let V be the 
convex cone of psh functions u on C^^^^ such that for a real c > 

(107) li(Az) = cln|A| A G C, z G C'^'+^ 

To any w in T-" we can associate a positive closed current of bidegree (1,1) on P*^': let 
s be a holomorphic section of tt on an open subset [/ C P*^, then dd^{u o s) defines 
a positive closed current S of bidegree (1, 1) on t/. If s' is another section of tt then 
s' = j ■ s for a holomorphic function j which does not take the value 0. Hence 
dd'^{u o s) ~ dd'^(u o s') so S does not depend on the particular section and defines 
a positive closed current on all P*"'. We denote by L : V ^ ^'k-i fe-i operator 
defined by L{u) = S. 

Proposition A. 3. — (^[45], theorem A. 5.1) For any positive closed current S of 
bidegree (1,1) on P*^ there exists a unique (up to an additive constant) function u V 
such that L{u) = S. The function u is called a potential of S. 

For example, if P is an irreducible homogeneous polynomial of degree d on 
then 

log|P(Az)| =dlog|A|+log|F(z)|, 
and by the Lelong-Poincare formula (106) the current [P = 0] has potential log 

A. 5. The Pubini-Study form, Kahler forms. — Consider on P'^ the closed pos- 
itive form Lu of bidegree (1, 1) with potential log on C'°+^. We take homogeneous 
coordinates 

[zo : zi : • • • : Zfc] 

on P'^ (i.e. the point [zq : ■ ■ ■ : z^] represents the image by tt of the point (zq, . . . , Zfc) 
of C'^^^). The space C*^' is identified with P*^ \ tt{{zq = 0}) taking for coordinates 
Wi = j^. On C*"' the form ui is given by (cf for example, [22], page 30): 

_ J_ / X] c^^^i A dwj _ {J^Wjdwi) A {J2 Wjdwi) \ 
2tt \ 1 + WiWi (1 + WiWiY ) ' 

The form w is called the Fubini-Study form on P*"' and has the following properties: 
it is smooth, closed, and at any point the coefficients (Sj^k) defined by equation (105) 
defines a positive definite matrix. In general, on a complex manifold a (1,1) form 
with these properties is called a Kahler form and a complex manifold with such a 
form is called a Kahler manifold. We do not want to enter into the details of this 
notion (cf for example, [22] or [6]) but we just want to point out that if X is a smooth 
analytic subvariety of P'^ then the restriction of the Fubini-Study form w to X defines 
a Kahler form on X (which is canonical for the embedding X C P*^). The volume of 
X defined as 

Jx 

is finite and actually equal to the degree of X. 
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If S' is a positive closed current on P*^' of bidegrec (p, p) on P''' then the total mass 
of S is defined as 

If S is of bidegree (1,1) and has potential u then j|5|| = c where c is the homogeneity 
constant appearing in formula (107). Indeed, the function v = u — clogj| • || is well 
defined on P*^, hence \\S\\ = c J w'^ + J d(Fv A o;*^"^ — c j uj^ since w*"'"^ is closed, and 
j Lo^ = 1. Finally, we mention that if {Sn) is a sequence of positive currents such 
that the total mass converges to then Sn converges to in the sense of currents (cf 
[45]). 

In the same way, if 5 is a current on X (or on any compact Kahler manifold) then 
11511 is defined hy ^^S S {uj\xY''^^~^ ■ 

A. 6. Pull-back, push-forward of a current. — Let / O ^ fi' be a holo- 
morphic map between open subsets of C™ and C™ . The pull-back f*a of a smooth 
form a in ^-j (fi') is well-defined as an element of _D(p q)(r2). Thus we can define 
the push- forward /*5 of a current S of bidimension (p, q) by duality, i.e. 

< us,c^>=<s,r<p>, V(^Gi?(p.,)(f}')- 

For some particular class of maps we can define the push-forward of differential 
forms and then the pull-back of currents (cf [45], A3) but we do not want to enter 
into details since we will only consider the case of (1,1) positive closed currents for 
which the situation is simpler. 

Suppose that the map / is dominating, i.e. that its differential is generically surjective. 
Let S* be a positive closed current of bidegree (1, 1) on fi'. Let zq be in and set 
Wo = f{zo)- For r > we can write S = dd'^u for a psh function u on B{'Wo,r). 
Choose ri such that f{B{zo,ri)) C B{wo,r). The function it o / is psh (indeed, it 
is not equal to — oo since / is dominating). This definition does not depend on the 
choice of the potential u since if ui and U2 are 2 potential of S then ui — U2, and 
hence (mi — U2) o / are pluriharmonic. Then the pull-back f *S is defined locally by 
f*S = dd'^uo f. In [45] it is proved that the pull-back is continuous on the set of 
positive closed currents. Remark that when / is not dominating the pull-back can be 
defined similarly, as soon as /(f2) is not included in the set where the potential of S 
is —00 (when / is not dominating the pull-back is a priori not continuous). We will 
see in next sections that actually the pull-back can be defined for meromorphic maps 
on compact complex manifolds. 

B. Dynamics of rational maps on the projective space P'^ 

B.l. Definitions, indeterminacy points. — Let P*"' be the complex projective 
space of dimension k and tt : C'^"''^ \ {0} P'^ the canonical projection. A point z 
in P'^ can be represented in homogeneous coordinates by 



z = [zq : ■ ■ ■ : Zk], 
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where [zq : ■ ■ ■ : Zk] denotes the point tt{zq, . . . ,Zk). Consider now a homogeneous 
polynomial map R : C'^+^ C''+^ of degree d, i.e. R ~ (Rq, . . . , Rk) where the Ri's 
are homogeneous polynomials of degree d in the variables (^Oi • • ■ , ^fc)- Suppose that 
the Ri have no common factor. It is natural to associate a map / on the projective 
space P*^ such that the following diagram commutes: 





R 




+1 


1- 






7r 


mfc _ 


f 


pfc 



The map / can be defined only on the set P*"' \ / where / = tt{z, R{z) ^ 0}. The set / 
is called the set of indeterminacy points of / and is an analytic subset of codimension 
at least 2 (indeed if all the Ri 's vanish on an analytic hypersurface then a polynomial 
can be factorized in R). Usually one writes / in homogeneous coordinates as 

/ = [^0, • ■ • , ^fc]- 

The function / is a rational map of P'= (a precise meaning to this notion is given at 
the beginning of appendix C) and the polynomial map i?, which is called the lift of / 
to C'^"''^, exists and is unique (up to a multiplicative constant) for any rational map 
of P*^. The degree of / is defined as the degree of i?, i.e. d. The map / is holomorphic 
on P*^ if and only if / = 0. The map / is said to be dominating if its differential 
is generically surjective. If / is dominating and if S' is a positive closed current of 
bidegree (1, 1) with potential u on 0*^+^ we define the pull-back f*S as the current 
with potential uo R. 

At a point p E I the image of / can be defined as a subset of P'^ : let Bp be the 
subset of P'' defined by 

Bp = a>o/(i3(p,e)\/) 
where B{p, e) is the ball of center p and radius e. Then Bp is an analytic subset 
of P*^ called the blow-up of / at p (as we will see in appendix C, the blow-up can 
also be defined using the graph of /). On the other hand an irreducible subvariety 
of dimension p can be sent into a subvariety of dimension strictly smaller. These 
phenomenons are new compared to the situation of 1-dimensional complex dynamics. 
This results in the fact that the degree of the iterates of / do not necessarily grow 
like d". Let us explain this clearly: suppose, for example, that a hypersurface V is 
sent by / on a point of indeterminacy. Then the map R^ is null on V and a hence a 
polynomial can be factorized in R^. The degree of is then smaller than degree(/)^ 
since is lifted to a polynomial map with degree smaller than that of R^. In general, 
we can always write 

R — Rji , 

where is a homogeneous polynomial and i?„ a homogeneous polynomial map, with 
no common factor, of degree c?„ = d" — deg(/i„). The map i?„ is a reduced lift of 
/", thus the degree of /" is c?„. We say that there is decreaseness in the degree if 
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Proposition A. 4- — f[45], proposition 4-3) Let f and g be rational maps of P'^ of 
degree d and d' . The degree of f o g is smaller than dd' and equal to dd' if and only 
if there does not exist any hypersurface V such that g{V \ Ig) C //. 

Definition-Proposition A.l. — The map f is algebraically stable if there does not 
exist an integer n and a hypersurface V such that 

r\v\i)ci. 

If f is algebraically stable the degree of /" is rf", but in general we only have the 
inequality 

We define the dynamical degree as the limit 

dao = lim - logd„. 

n— »oo n 

The map f is algebraically stable if and only if doo = d. 

Proof: the proof of this result is clear from proposition (A. 4). Indeed d„ = for 
all n if and only if / is algebraically stable and if (i„ < d" for a n > then clearly 
the limit doo (which exists by subadditivity) is smaller than d. □ 

B.2. Green function and Green current. The algebraically stable case. — 

Let / be a rational map, algebraically stable, with degree d. We denote by /„ the set 
of indeterminacy points of /", we have /„ C Im for n < m, and we set loo — U^]^/„. 
We recall the following definitions. 

— A point p in P*"' \ loo is in the Fatou set of / if there exists a neighborhood U of 
p such that /|^ is equicontinuous. 

— The Julia set is the complement of the Fatou set. 

— A point p is normal if there exist neighborhoods U oi p and y of / such that 
f"'{U) n y = for all n. We denote by N the set of normal points. 

Denote by G„ : C'^+i ^ KU {-oo} the psh function 

(108) G„(2) = log|ii?"(z)||, zeC''+\ 

Remark that Go is by definition the potential of the Fubini-Study form oj on P'^ and 
that Gn is the potential of the pull-back Sn = (/")*ti'. 

Theorem A.l. — ^[45], Theoreme 6.1, 6.5, 7.1) Let f be a rational map, alge- 
braically stable, with degree d. The sequence -^Gn converges pointwise and in ^J^^ 
to a psh function G satisfying: 

G(Az) =log|A| +G(z) 
G{R{z)) = dG{z) 

The function G is called the Green function of f . The current S with potential G is 
called the Green current of f . It is the limit of the sequence ■^{f '")*uj and satisfies 

f*S^ dS. 

i) The current S does not charge hyper surf aces. 
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a) The support of S is contained in the Julia set of f . The set N n (P'^ \ suppS) 
is contained in the Fatou set (in particular, when N — W'^ , the Julia set equals the 
support of S). 

Hi) The Green function is Holder continuous in the set of normal points Tr^^(N). 

Remark A. 2 : The question of whether the sequence of currents -^{f")*So con- 
verges to S when we start from a particular current 5*0 is not easy in general. In 
particular, it is interesting to consider the preimages of the current [V] of integration 
on a hypersurface V. In this case the limit ^(/")*[^] represents the asymptotic 
repartitions of the preimage of V. Generically, the limit is S (cf [45]), but for a 
particular V the problem to know whether the limit is S' is a priori not easy. This 
is more or less the problem we encounter in a particular case to prove theorem (3.1). 
There are general results for this problem in the case of birational maps on compact 
Kahler manifold, cf [12]. 

B.3. The non algebraically stable case. — When / is not algebraically stable 
then we can write for n large enough 

Jt hji Rn , 

where h„ is a homogeneous polynomial of positive degree, R„ a homogeneous poly- 
nomial map with non common factor. We can still define G„ by equation (108) and 
Sn as the current with potential G„. Remark that in this case Sn is not equal to the 
pull-back (/")*a; since the map i?" is not reduced (i.e. its components have common 
factors). Precisely, we have 

Sn = (/")*t^+[/l„ -0]. 

Indeed, we see that 

dd"log||i?"|| dd"log||i?„|| +dd"log|/i„|. 

The first term equals {f^)*Lu since i?„ is a reduced lift for /" and log |/i„| is a potential 
of [hn = 0] (counting multiplicities, i.e. [hn = 0] stands for the current of integration 
on the divisor of /i„) by the Lelong-Poincare equation. Remark also that hn+i divides 
so that we have [hn+i = 0] > d[hn = 0] (counting multiphcities) . This implies 
that -^[hn = 0] converges towards a current with support contained in U,i{/i,i — 0}. 
On the other hand, we remark that the total mass of (/")*a; is equal to the degree of 
i?„, i.e. dn, thus -^{f^)*Lo converges to 0. This sums-up in the following result. 

Theorem A. 2. — (cf [45] , Theoreme 9.1) When f is not algebraically stable then 

(109) lim ^[hn = 0\ 

and the current S is supported by a countable union of hyper surf aces. 

Remark A. 3 : We see that in this case the current S does not contain much infor- 
mation about the dynamics of /, but just about the distribution of the hypersurfaces 
going to indeterminacy points. 



C. ITERATION OF MEROMORPHIC MAPS ON COMPACT COMPLEX MANIFOLDS 87 



C. Iteration of meromorphic maps on compact complex manifolds 

C.l. Definitions, indeterminacy points. — Let X and Y be compact complex 
manifolds. Denote by tti : X xY ^ X and 7r2 : X y. Y ^ Y the projection on 
the first and second components of X xY . A meromorphic function / : X Y is 
defined by its graph F/ C X x F, an irreducible subvariety oi X xY for which the 
first projection is a proper modification, i.e. such that there exists a proper subvariety 

V <Z X such that tti is a biholomorphism from T f\ 'Ki^{V) to X\V . We denote 
by // C X the set of points of indeterminacy, i.e. the set of points where tti has no 
local inverse. The set If is an analytic subset of codimension at least 2. Of course, 
at a point x € X \ If the image by / is defined by f{x) = 'K2{n^^{x)). When x is an 
indeterminacy point the image by / is an analytic set defined by f{x) = 7r2(7r^^({a;})). 
The map / is liolomorphic oiiX\If. The map is said to be dominating if 7r2 is 
surjective. 

If 5 : y — > Z is another meromorphic map then the graph Tgo/ is defined as the 
closure: 

Tgof = {{x,g{f{x))), xeX\If, f{x)eY\Ig} 
One can also consider the graph 

Tg oTf ^ {{x, z), 3y eY such that (.t, y) €Tf and (?/, z) € Tg}. 

Proposition A. 5. — (cf [12], proposition 1.5) The equality Fgo/ = o Fy is sat- 
isfied if and only if Tg o Tf is irreducible and this is true if and only if there is no 
hypersurface V <Z X such that f{V) C Ig. 

Definition A.l. — A dominating meromorphic map f : X X is said to be 
analytically stable if Tf o Tfn — Fyn+i, i.e. there does not exist an hypersurface 

V <Z X and an integer n such that f"'{V) C //. 

Remark A. 4 : When X is a smooth algebraic projective variety (i.e. a smooth 
irreducible analytic subset of a projective space) the terminology meromorphic map 
and analytically stable are replaced by rational map and algebraically stable (due to 
the algebraicity of the manifold). In the case of a rational map on the projective space 
defined as in appendix B the reader can check that the definitions are consistent. 

C.2. Action on cohomology groups. — We suppose now that X is a smooth 
algebraic variety, i.e. that it can be embedded as a smooth irreducible analytic subset 
of a projective space (actually, we could only suppose that X is a Kahler manifold). 
The counterpart of the degree in the case of projective spaces will come from the action 
of / on the cohomology groups of X. We first need to introduce some notions and 
notations. We denote by H^{X,C) the De-Rahm ?'-cohomology group of X, i.e. the 
quotient of closed r-differential forms by exact r-differential forms. The cohomology 
class of a current can also be defined since there is identification between H'^{X, C) and 
the quotient of closed currents of degree r by exact currents of degree r. We denote by 
{a} the class of a differential form (or current) a. For us the Dolbeault cohomology 
group _ff (X) will be the subspace of HP'^'^{X, C) of classes of differential forms of 
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bidcgrcc (p, q) (in general the Dolbeault cohomology groups are not defined in this 
way but in the case of Kahler manifolds there is identification). 

Let / : X —f X he a rational map. Using a desingularization of the graph Tf (we 
do not want to enter into the definition of this notion here) it is possible to consider 
the pull-back of 7r2 in the sense of forms and the push-forward of tti in the sense of 
currents. This allows us to define the pull-back f*a = 7ri*(7r2a) for all smooth form 
a € Dp q{X) as a current on X. The push- forward /* can be defined similarly. We 
do not want to enter into details of the construction here (cf [12] or [13]), but we just 
want to point out that /* and /* have the following properties 

— /*Q! is smooth on X\If, 

— f*a is in L^^^-, 

— f* and /* commutes with d. 

By the third property we see that the operators /* and /* induce linear operators on 
the Dolbeault cohomology groups ij(p,9)(X) by 

/*{«} = {/*«}, Va G Dp^giX). 

In general, it is not possible to define the pull-back /* on the space of currents in 
a continuous way (cf [13]) but when S* is a closed positive (1, 1) current we can define 
f*S ~ TTi.pTrjS' where the pull-back ttjS* is defined as in appendix A. 6 using locally 
a psh potential for S and the push forward is defined in the sense of current. The 
pull-back /* has the following properties (cf [13], proposition 2.2.8): 

— /* is continuous on the cone of closed positive (1, 1) currents. 

— For any hypersurface V C X 

nv]^[f-\v)]. 

— f *{S} = {f *S} for any closed positive (1, 1) current S. 

C.3. The matrix of degrees. — Suppose now that 
(110) X ^ XiX ■■■ X Xr. 

where the Xi^s are smooth algebraic varieties, simply connected, and such that 
dime H^'^{Xi) = 1 for all i in I,-- - ,r. Since X is Kahler and simply connected 
we have H^'°{X,) = H°-^{Xi) = and thus H^-^{X) = H^^^{Xi) © • • • ® H^-^{Xr) 
is of dimension r. Consider Ui the Kahler form on Xi obtained by restriction of the 
Fubini-Study form to Xi for an embedding of Xi in a projective space and renormal- 
ized to be a generator of the Z-cohomology. By abuse of notations we also denote by 
Vi the form on X obtained as the pull-back of the form Vi on Xi by the canonical pro- 
jection on the i-th coordinate of the right term of (110). The family ({i^i}, . . . , {i^r}) 
gives a natural basis of H^'^{X). In this basis the linear operator (/")* on H^'^{X) 
is represented by a matrix dn = {dn,i.j) defined by 
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Proposition A. 6. — i) The matrix dn has non-negative integer coefficients. 

ii) The sequence of matrices {d„) is submultiplicative, i.e. dn+m < dndm with 
equality for all n, m if and only if f is algebraically stable. 

Proof: i) Consider the group of integral classes H^'^iX) = H^''^{X) n H'^{X,Z) 
where {X, Z) is the cohomology group with values in Z (actually a class a is integral 
if its integral along any 1-simplex is an integer). By hypothesis, the element {vi} is a 
generator of the group H^' (Xi). Therefore ({i^i}, • • • ,{1^^}) generates H^' (X) and 
the coefficients of d„ are integers since the linear operator /* leaves invariant the 
lattice H^'^{X)n H'^{X,1) (cf [12], proposition 1.11). The positivity of coefficients 
conies from the following fact: let Hpf^^f be the cone of classes {S} generated by closed 
positive currents. In our case it is easy to sec that hIi\ is the cone of elements with 
positive coordinates in the basis ({i^i}, . . . , {^^r}): indeed, suppose that {S} e -f^pse/ 
then < Vi^l\- ■ ■l\Vi^_^ >> for all choice (ii, . . . , in-i)- Thus, if {S} = X^iLi 
we can choose (ii, . . . , i„_i) such that < S,Vi^/\- ■ ■ l\Vi^_^ >~ Sj. Finally, we conclude 
the proof using the fact that the cone Hps\f is left invariant by /*, cf [12], proposition 
1.11. 

ii) This is a direct application of proposition 1.13 of [12]. 

Remark A. 5 : In our case a considerable simplification comes from the fact that we 
assumed (110). This imphes that the cones H^'Jf.f and H^^^j: considered in [12] are 
equal and coincide with the cone of classes which have positive coordinates in the 
basis {{I'l}, {i^r})- 

C.4. Green currents. — We take from [13], [45] the following result. 

Theorem A. 3. — Let f be a dominating meromorphic map, algebraically stable. Let 
a be a smooth closed positive form of bidegree (1, 1) such that the cohomology class 
satisfies /*{«} = p{ol\ for a positive real p > \. 

(i) The sequence of currents p~"'{f"')*a converges towards a positive closed (1, 1) 
current S such that 

(111) f*S = pS. 

The current S depends only on the cohomology class of a, i.e. if a' is a smooth 
differential form cohomologous to a then the limit is the same. 

(ii) The support of S is included in the .Julia set of f . 

Remark A. 6 : When the matrix di is primitive (i.e. when di admits a power with 
strictly positive coefficients) there exists a unique (up to a multiplicative constant) 
class with positive coordinates which satisfies equation (111). Thus, the current S 
defined in this way is unique (up to a constant) and it is natural to call it the Green 
current of /. 

C.5. Examples. — The projective spaces 

Let X = P'^. Since dime H^'^{F'') = 1 the matrix dn is scalar and actually equals the 
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degree of the map / as defined in appendix B. fndced, if lu is the Fubini-study form 
on P*-' then the potential logj|i?„|| of {f")*uj has the following homogeneity 

log ||i?„(Az)|| = deg(r) log |A| + log \\Rn{z)\\. 

This imphes that u(z) = log ||i?„(2;)|| — deg(/") log ||z|| is defined globally on P'^ and 
thus that deg(/")w - {D*lu = dd'^u. Thus dJicu} = {(/")*w} = deg(/"){w}. 

X = Pi X • • • X pi (r times). 

A point z in X can be represented in homogeneous coordinates by 

(112) z = {[xi : yi], . . . , [x^ : y^])- 

A map f : X X can be represented in homogeneous coordinates by 

f = i[Pi:Qi],...,[Pr:Qr]), 

where Pj{xi,yi, . . . , Xr,yr) and Qj(xi,yi, . . . ,Xr,yr) are polynomials homogeneous 
in the variables [xi,yi) with same degree and no common factor, i.e. we have 

P] {xi,yi, . . . ,Xxi,Xyi, . . . ,Xr,yr) = A"*'-^ Pj {xi,yi, . . . ,Xr,yr) 

(and idem for Qj) if the degree of {Pj,Qj) in the variables {xi,yi) is d^.j. It happens 
that the degrees {di j ) coincide with the matrix of degrees of / defined previously (cf 
[21]). 

D. A different proof of lemma 3.3 

We present here a different proof of lemma 3.3. This proof does not involve any 
direct estimate but just the fact that 5+ is T-invariant and general properties of 
holomorphic maps on 5*+. 

On S+ we consider the hyperbolic metric given by (cf [46], [50]) 

ds^ = tTiice(y-^dQV-^dQ), for Q + iV e S+. 

It is well known that 5-1- can be identified with sp(n, R.)\U{n), and that ds^ is invariant 
under the action of the symplectic group sp(2n, R) (cf [46], page 3, cf [50]). The 
geodesic distance induced by ds^ on S+ is given by (cf [46]) 

1 4- * 

(rfs+(Q,Qi))' = E(log'(^^))' 

where < ri < • • • < r^p^ < 1 arc the characteristic roots of the cross ratio R{Q, Qi) 
of Q, Qi given by 

RiQ, Qi) = {Q- Qi){Q - Qir\Q - Qi)(Q - QiT' 

(i.e. this means that the r^'s are the eigenvalues of ^JR{Q, Qi)R{Q, Qi)*. These 
values rk satisfy < < 1, cf [46], page 16). 

The upper-half plane S+ can be mapped holomorphically onto the matrix ball 

{£ complex sym, / — ££ > 0} 
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by the Cayley transform 

(113) Q ^ £ = (Q - ild)iQ + ildy\ 
Inverting this relation we get 

(114) Q = i{ld + £){ld-£)-\ 

With these notations it is clear that the cross ratio R{Q,ild) is given by 

(115) R{Q,ild)^££. 

The key property we are going to use is the following generalization of the Schwartz- 
Pick lemma (cf [29]). Let / be a holomorphic map from 5*+ to S+, then for any x, y 
in S-i- 



(116) cis+(/(x),/(y)) < V\F\ds^ix,y), 

{\F\ is the rank of the symmetric space S+. The exact value of the constant does not 
matter, the important point is that it does not depend on the function /). 
Then we prove the following lemma instead of lemma 3.1. 

Lemma 3.1-bis. — i) The map T is holomorphic on S+ (resp. on S^) and S+ 



(resp. S^) is T -invariant. Moreover, for any Q in S+ and n we have 



(117) ds^{iId,r'Q) < y/\F\{ds^{iId,Q) + nds^{iId,T{iId))). 

ii) For any Q in 5+ we have the following inequality 

dct{Id+QQ) < 2l^lexp(2|i^|ds^(iW,Q)). 

Proof: The fact that 5*+ is T-invariant is proved in lemma 3.1. Using (116) for 
each of the iterates T" (indeed, each T" is a holomorphic map from S+ to 5+) we get 

ds+iild,r'Q) < ds+{iId,r'{ild)) + dsjT"{ild),T"Q) 

n-l 

< ^ds+(T*(zId),T^-+i(*Id)) + ^\ds4ild,Q) 

k=0 



< ^\F\{nds^{ild, ^(^Id)) + ds^ {Hd, Q)). 

ii) Let £ be the image of Q by the Cayley transform (113). Let p be the largest 
eigenvalue of ££. We have p < 1 and we deduce from (115) that 



ds^iild,Q)> log 
Considering now relation (114) we deduce 

QQ< 



1 — /92 



1 — p2 



which immediately implies 

det(Id + QQ) < 2l^lcxp(2|i^|d5+(Q,iId)). □ 
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Proof of lemma (3.3). This will be a consequence of the estimates we proved in 
lemma (3.1-bis). We first remark that the terms of the sequences in formulas (58) 
and (59) are non-positive. By proposition (3.1), lemma (2.1) and lemma (3.1-bis) we 
have: 

fl"(exp7/Q7?) ^ expryr"Qr; 

' ||i?«(exp7yQr;)||' ' ' || exp?7T"Q?/|| ' ' 

1 



exp rjT^QrjW 
1 



,det(Id-f r"QT"Q), 

> 2-^1^1 exp(-|F|ds+(r"Q,iId)) 

> 2-^1^1 cxp(-|F|y^F|(o^s+(g,^Id) + nc^s+(^Id,^(^Id)))). 



This immediately implies equality (58). 

The proof of formula (59) works similarly. Remark first that for any Q in 5*+, 
dg+{ild,Q) — dg+{ild, —Q~^) (indeed, Q — s- —Q~^ is an isometric of S'_)_ fixing ild). 
Using proposition (3.1) and lemma (2.1) we get: 

ITiexpjQiT) _ |det(r"Q)| 



|i?"(exp^Q??)|l' |lcxp7?T"Q77|| 

- ( V 

\det(Id+(r«Q)-i(r"0)"') / 
and we conclude similarly using lemma (3.1-bis). □ 

Remark A. 7 : We proved in theorem 3.1 the convergence of the counting measure 
for the Neumann and Dirichlet boundary condition. The technic presented in this 
appendix allows, with a little extra effort, to prove the convergence of the counting 
measure for any boundary condition. Indeed, for each n let i?„ be a real symmetric 
operator on M^<''> supported on 9-F<„> (i.e. i?„/ = if f\dF^„^ = 0) (we can thus 
also consider Bn as an operator on M.^ by identifying 9F<„> with F). We consider the 
boundary condition induced by Bn, i.e. we denote by v^ny the counting measure of 
the eigenvalues of y4.<„> — Proceeding as for the Neumann and Dirichlet boundary 
condition, we can prove that i^<Ji> is given by 



z.f;> = ^Aln| < exp(-^i3„77) • i?"(0(A)), [] r]^rjx > 
We can as well replace the last expression by 



277 ||cxp(?7B„77)|| 
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By the same strategy as before wc see that the convergence of i^!ln> would be implied 



by the following convergence for Q in S+ 

n~X^ TV" ' " II exp(-77S„77)j| ||i?"(exp^Q?7)| 



J_ ^ exp(-7/B„r?) R'^jexpijQrj) _ 



xeF 

We see that as before the term in the logarithm is bounded from above by 1. The 
term inside the logarithm is equal to 

exp77(T"Q~i?„)77 -p., 
I II exp(-^i?„,7)|| II expryT"Qr;|| ' li '^^'^^^ ' 

(^^g) ^ |det(r"Q-i3„)| 

(det(Id + T^T«Q) det(Id + 5,2)) ^ 

The key point is that the change of boundary condition can be viewed as a " rotation" 
in 5*+ (by a rotation in S-i- we mean the image by the Cayley transform of a rotation 
in the unit ball). It is actually easier to map everything in the unit ball since rotations 
have a simple expression. Let us first derive some simple formula. Let Qi and Q2 
and and Sq^ there images by the Cayley transform. Then a direct computation 
gives 

|det(QOp ^ |det(Id + gQjp 
det(Id + QiQi) det(2(Id + £Qi£Qj)' 

|det(Qi-Q2)P _ |det(2(fQ, -fQj)|2 



det(Id + QiQi) det(Id + Q2Q2) det(2(Id + £q,£q,)) det(2(Id + £q,£q,)) 

In particular in the last expression if Q2 ~ B is a, real matrix then £b is unitary and 
we get 

|det(Qi-g)p ^ |det(gQ, 

det(Id + QiQi) det(Id + B^) det(2(Id + £q,£q,)) ' 
If we apply this to (118) we get 

|det(gT^Q-gBj| 

det(2(Id + fT"QfT"Q))^' 

The isometrics of the unit ball that fixes the point (the rotations) are exactly the 
maps £ — > U^£U for U unitary (cf [46], page 11). If we take any J7„ that sends £b„ to 
—Id and if we denote by t„(T"(5) the point of S+ such that £t„{t^^q) = U^£T"QUn, 
then we have (ild, r(r"Q)) = (ild, T"(5) and the last expression equals 

|det(Id + £:,(j,„Q))| 



det(2(Id + f,(TnQ)f.(T"g))) = 
|det(T„(r"Q))| 



(^det(id + r„(r"g)T„(r"Q))j 

Then we can apply as previously the estimates of lemma 3.1-bis to conclude. 
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E. G-Lagrangian Grassmannian 

Let us first recall the classification of complex irreducible representations, and the 
Frobenius-Schur Theorem. Let G be a finite group and U an irreducible representation 
of G over C. We denote be x its character. The representation U is said to be 

— of type 1 if the character x is not real. 

— of type 2 if the character of x is real, and the representation U is realizable over 
K (i.e., U can be realized as the complexification of an irreducible representation 
of G over M). 

— of type 3 if the character x is real, but U is not realizable over M. 

Let us now recall a consequence of the Frobenius-Schur theorem (cf [44] , proposition 



Proposition A. 7. — i) If G does not have a non-zero invariant bilinear form on U , 
then U is of type 1. 

a) If such a form exists, it is unique up to homothety, is non-degenerate, and is 
either symmetric or skew- symmetric. If it is symmetric, then U is of type 2, and if 
it is skew- symmetric, then U is of type 3. 

Let us now consider an irreducible representation W of G over R, and denote by 
VF"' its complexification. Then, there are three possible cases (mutually exclusive). If 
W"" is irreducible in C, then W"" is of type 2, and by extension we say that W is of 
type 2. If is not irreducible in C, then W = U (BU, where U and U (the complex 
conjugate of U) are irreducible in C. In this case U is necessarily of type 1 or 3. If 
U is of type 1, then so is U, and U and U are not isomorphic. By extension, in this 
case, we say that W is of type 1. If U is of type 3, then so is U, and U and U are 
isomorphic. By extension, in this case, we say that W is of type 3. 

Let us now introduce some definitions. Let n be an integer. We consider C^" = 
We denote by (, ) the canonical symmetric bilinear form on C^", {X, Y) ~ 
X*Y, and by <, > the canonical hcrmitian scalar product, < X,Y >= {X,Y). We 
denote Idn the n x n identity matrix and by J„ the 2n x 2n antisymmetric matrix 
defined by 



We define three types of Grassmannian on C^". We first denote by G"'^", the 
Grassmannian of n dimensional subspaces of C^". The group Gl{2n,C) acts tran- 
sitively on G"'^", and G"'^" is isomorphic to the homogeneous space G/(2n, C)/P„, 
where 



In particular, the tangent space of G"'^" is isomorphic to Af„(C). 

We recall that we defined L" as the set of Lagrangian subspaces of C^", i.e. as the 

set of n-dimensional isotropic subspaces for the canonical symplcctic form uj{X, Y) = 



38). 



(119) 
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{X, JnY). Wc denote by Sp{n,C) the linear symplectic group, i.e. the group of com- 
plex 2n X 2n matrices S, such that S^JnS = J„. The group Sp{n, C) acts transitively 
on the set of Lagrangian subspaces of C^" , and L" is isomorphic to the homogeneous 
spaces Sp{n,C)/ Pn, where P„ is the parabolic subgroup 



In particular, the tangent space of L" is isomorphic to Sym„(C), the space of complex 
symmetric n x n matrices. 

We consider now the non degenerate symmetric bilinear form {X, KnY) on C^", where 
Kn is the symmetric matrix 



We denote by O" the set of maximal isotropic subspaces, for the symmetric bi- 
linear form (-ji^n-), i.e., the set of n-dimensional isotropic subspaces of C^". The 
group 0{'C^^^ , Kn) of linear transformation which preserve the bilinear form (•,_ftr„-) 
is isomorphic to the classical orthogonal group 0(2n, C) (indeed, {-.Kn-) is sym- 
metric and non degenerate) and acts transitively on O". Hence, O" is isomorphic 
to 0(C^", /\,i)/P„, where P„ is the parabolic subgroup which leaves invariant the 
isotropic subspace C" © 0, 



In particular, the tangent space of O" is isomorphic to the space of n x n complex skew 
symmetric matrices. We denote by SO{C'^"' , Kn) the subgroup of 0(C^",isr„) of ele- 
ment of determinant 1. Since P„ C S'0(C^", Kn), O" has two connected components, 
SOiC^",Kn)/Pn and ^SO{C^" , Kn)/^Pn, where ^ is any element of 0(C2", /s:„) with 
determinant -1. We denote by SO" = SO{C'^"' , Kn) / Pn, the connected component 
which contains the Id • P„. 

We suppose now that k is an integer and that R'^ is an orthogonal representation 
of a finite group G, i.e. we consider G as a finite subgroup of the orthogonal group 
0{k,M.). The vector space C*^ is a complex representation of G, and we consider the 
diagonal action of G on C^*^ = C*^ C*^, i.e. G is the subgroup of 0(2k) of elements 
of the form 



We consider the Lagrangian Grassmannian L'^ ~ Sp{k, C) /Pk ■ We denote by L'-^ C L*"' 
the subvariety of G-invariant Lagrangian subspaces. We know that Symj,(C), the 
space of k x k symmetric complex matrices, is embedded in L*"' as follows 




(120) 




(121) 





Symfe(C) 



k 



k 



Q 
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where {ei, . . . , e^, e'j^, . . . , e'^,} is the canonical basis of C^'^. We denote by Sym (C) 
the subspace of Symj.(C) of Q which commutes with G. It is clear that the Lagrangian 
subspace Lq is invariant under G if and only if Q € Sym'^(C). We denote by L*^ the 
closure in L'' of Sym'^(C). It is clear that L'^ C L'^. 

We suppose that M'^ is decomposed into isotopic representations as follows, 

(122) M*^' = Vb e • • • ® Vr, 

where Vi is an isotopic representation equal to the direct sum of rii representations iso- 
morphic to a single R- irreducible representation Wi (and the Wi are not isomorphic) . 
This means that Vi = Wi^i ® • • • ® Wi^m, where the Wi^j are isomorphic to Wi and 
we can choose the Wij orthogonal. For simplicity, we write sometimes Vi = UiWi- 

Theorem A. 4- — The suhvariety Jj^ is the connected component of\J~^ which con- 
tains the Lagrangian subspace C'' 0, and is isomorphic to 

Co X ■ ■ ■ X Cr, 

where 

— Ci ~ ([J"i^2ni ij' \Yi is of type 1; the dimension of Ci is nf. 

— Ci ~ L"' if Wi is of type 2; the dimension of Ci is ni(ni + l)/2. 

— Ci ~ §0^"' if Wi is of type 3; the dimension of Ci is 2nf — Ui . 

Proof: Let us first introduce some notations. If M = (Mij) is a n x n matrix and 
N a. m X m matrix, we denote hy M iSi N, the mn x mn matrix of the tensor product, 
given by blocks by 

I M,,,N J 

\ / i.j — l---n 

If ?7 is a subspace of C'^ , then we will denote by U and U' the subspaces of C^'^ , 
equal respectively to the copy of U on the first and the second component of C'^ C*^, 
so that we have U' = JkU. Similarly, if / is a vector of C*^, we denote by / and 
/', respectively the copy of / on the first and second component of C'^ © C'', so that 
/' = Jf. We denote by Vf the complexification of Vi. Hence, with the previous 
notations we have 

(123) c^*^ = ® • • • © v^^ © (T/(f )' © • • • © {v^y. 

Let us first prove that L*^ is a connected component of L'-^. The space Symj.(C) is 
embedded in L*"' and. with this embedding, 

Symfe(C) = L*^' \{Le L^ L n (0 © C'=) 7^ {0}}. 

As we already remarked, we know that a Lagrangian subspace of the type Lq is in 
L*^ if and only if Q is in Sym'^(C). Otherwise stated, it means that 

Sym^(C) = \ {L e L^, L n (0 © C*^') ^ {0}}. 
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s = 



Since Sym'^(C) is connected, it means that L'-^ is a connected component of L*^. We 
set 

S'pG(c) = {Se Sp{k, C), gS = Sg, Vg € G}, 
and ~ Pk D Sp'^ . Let us now prove that L'-^ is isomorphic to the connected 
component of Sp'^ / P'-' which contains Id • P'^ . Indeed, Sp*^ /P'^ is isomorphic to the 
subset of L*^ ~ Sp{k,C)/ Pk of Lagrangian subspaces L such that there exists S in 
Sp'^iC), such that 

S{C'' e 0) = i. 

Hence Sp'^/P^ C L'^. But for Q in Sym^(C), 

Idfe 
Q Idk 

is in Sp^{C) and 5(C'= © 0) = Lq. Hence, Sym^(C) C Sp^/P^, and thus C 
Sp'^ / P^ , since Sp'^ / P'^ is compact. This implies that L*^ is a connected component 
oiSp^{'C)/P^. 

Remark A. 8 : It is not true in general that L*^ ~ Sp'^/P'^. Actually, we have the 
inclusions L'-^ C Sp'^ /P'^ C , and each of these inclusions can be strict. We will 
try to clarify this point in a subsequent work. 

Let us first prove that we can reduce the problem to the case where MJ' contains 
a unique type of irreducible representation, i.e. to the case where r = 0. Since the 
subspaces Vi, V- are real orthogonal, the subspaces Vf {Vf')' are w-orthogonal and 
the restriction of the symplectic form uj to Vf' {Vf')' is non degenerated, hence is a 
symplectic form. This implies that 

and 

pG ^ pGfyC ^ (^yCy^ ^ . . . X pGf^yC ^ (-^C)/)^ 

where Sp'^{Vf © {Vf^)') is the group of G-invariant symplectic transformation on 
Vf- © {Vf-y, and P'^iVf' © {Vf-)') the subgroup which leaves invariant V^^. Hence, 
L'=' ~ CqX-- -xCr, where £i is the connected component of S'p'^(F^'C©(T/,'^)')/P'^(V;^© 
{VfY), which contains Id • P^iVf © (K;^)')- 

Hence, we suppose now that R*' contains a unique type of irreducible representa- 
tions, i.e. that R'^ = nW = PFi©- • -(BWn- This means that we have the decomposition 

(124) C^*^ = W^f © • • • © H/^ © {w^y © • • • © (w^y. 



If W if of type 2. 

This is the simplest situation. In this case Wj' and {Wj'y are irreducible over C. 
Let us set p = dimPI^, and choose real orthonormal basis {gi.j, ■ . . ,gp,j) of Wj, which 
realize the isomorphism Wj ~ Wj' . We denote by {g'^ ^ ) the corresponding basis of 

Wj. By Schur lemma, we know that, in this base, any element of End'^(C'^ © C*"') 
(where End*^ is the space of endomorphism commuting with G), is of the form 

Id„, 
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where M S M2„(C). Smcc the change of base is orthogonal, the matrix of the 
symplcctic form uj remains equal to 

Jk = Jn® Idp. 

This implies that, by this change of bases, Sp'~^{C) becomes the space of matrix of 
the type M (g) Idp such that 

(M (g) Idp)*( J„ (g) Idp)(M ® Idp) = Jn (g Idp, 

which is equivalent to M^J^M = J„. Hence Sp'~'{<C) ~ Sp{n,C). Similarly, P"^ is 
isomorphic to P„ and L'-' ~ L", since Sp{n,C)/Pn is connected. 

// W is of type 1 . 

In this case, W'^ = U S) U, and U and U arc C-irreducible, not isomorphic, and 
orthogonal for the hermitian scalar product <,>. Let p = dimVF, and choose an 
orthonormal basis (gi, . . . , gp) of W (for the hermitian scalar product). The family 
(^j^, . . . ,^p) is an orthonormal basis of U. 

By isomorphism, we have the corresponding decomposition Wj' — Uj(BUj, {Wj')' — 
U-®u'j, and the corresponding basis {gij, . . . ,gpj), (gi^, . . . ,5pj): and {g[^p . . ■,gpj), 
{g'lj, ■ ■ ■ ,9pj)- We rewrite now the decomposition of C^*"' as 

C^'' = f/i ® • • • ® [/„ ® ® • • • e e Fi © • • • © I7„ © c7'i © • • • © I7'„, 

and we denote by B the corresponding basis (i.e. we endow each component with the 
basis {gij), {g'ij), ■ ■ ■ , we just described). 

By Schur lemma, in this basis, any element of End'^(C'^ © C*"') has the form 



(125) Z 



Zi (g) Idp 
Z2® Idp 



where Zi and Z2 arc 2n x 2n complex matrices. Let us now compute the matrix of 
the symplcctic form to in this new basis (the change of basis, from the canonical basis 
of C^^^ to B is unitary, but not orthogonal). Since w(X,y) = (X, JY) =< X,JY >, 
we see that uj is null on all term except on the Uj x Uj , Uj x Uj , and the symmetric 
terms. On Uj x Uj, we have 



On Uj X Uj, we have uj{g[j,g^, j) ~ —uj(giij,g[j) = Siy. Hence, the matrix of w in 
the base B is 

Jn<E) Idp 



Jn «) Idp 



J = 

Hence, by this change of basis, Sp^{C) is isomorphic to the group of matrices Z of 
the form (125), which satisfies Z*JZ = J. Hence S'p'^(C) is isomorphic to 

(126) {^^(^0 Z2 ) ' ^^'^2 e A/2„(C), ZUnZl = Jn}. 
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Similarly. P'~^ is isomorphic to the subgroup of element Z of (126), such that Zi and 
Z2 arc of the form 




Since Z2 is determined by Zi in (126) by Z2 = -Jn{Z{)~'^, we see that Sp^{C)/P^ 
is isomorphic to 

Gl{2n,C)/ \z eGl{2n,C), Z of the form ( * * U ~ G"'^". 



If W is of type 3. _ _ 
In this case W = U ® U, where U and U are irreducible and isomorphic. Let us 
first remark that U and U are necessarily orthogonal for the hermitian scalar product 
<, >. Indeed, by proposition A. 7, we know that the symmetric scalar product (, ) is 
null on U, thus < x,y >= {x,y) = for x G U and y G U. Let us now describe 
an explicit isomorphism between U and U. By proposition A. 7, we know that there 
exists a non degenerate G-invariant skew symmetric bilinear form B on U. Thus, for 
all X in U, there exists (j){x) S U such that 

B{x,y) = < (t){x),y>, \/y eU. 

The map 4> is antilinear (i.e. (piXx + J/) = A(/)(a;) + 4>{y)) and bijective, since B is non 
degenerate. Thus, ijj = (j) : U ^ U , \s dca. isomorphism, commuting with the action of 
G. Since B is skew-symmetric and non degenerate, dimJ7 = 2p, and there exists a 
symplectic basis (gi, . . . , g2p) of J7, i.e. a basis such that 

B{gi,gj) = Si^-j+p — Si^j-p, 

(i.e., the matrix of B in this basis is Jp). We set fi = ■i/j{gi). The family (/i, . . . , f2p) 
is a basis of U, which realizes the isomorphism U ~U . 

Let us come back to C^*^. In each term Wf (resp. {Wf)') of the decomposition 
(124) we make the corresponding decomposition VKj' = Uj Uj (resp. (Wj')' = 
U'j © U j), and we define the corresponding basis (51^, . . . , <72p,i) and (/ij, . . . , fip^j) 
(resp. {g[^j, g'2pj) and (/{ j, . . . , /sp^))- 

We rewrite the decomposition of C^*^' in 

C^'' = f/i ® • • • e [/„ ® c7i ® • • • ® c7„ e [/{ ® • • • © f/; e c/'i e • • • e I7'„, 

and we denote by B the corresponding basis (i.e., we endow each component by the 
basis (gij, . . . , g2p,j)i {fi.ji ■ ■ ■ 1 .f2p.j)i ■ • we just described). By Schur lemma, the 
matrix of any element of End'^(C^'^) in the base B, is of the type M ® Id2p, where 
M e M4„(C). 

Let us now compute the matrix of lu in the basis B. Clearly, since uj{X,Y) = 
{X, JY), we see that uj is null on all component except of C^*"' x C^'^ except on 
components of the type Uj x Uj, Uj x t/j, and the symmetric components. On 
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Uj X Uj, we have 

i9t,] , fiy ) = - < 5» J- , 7i' J- > 



Similarly, uj{fij, g^/^) = —{Si^i'-\.p — Si^'-p). Thus, the matrix oi oj \n B is 

where K is the symmetric matrix 

k=( 

\ Jn 

Hence, we see that Sp^ (C) is isomorphic to the set of matrices of the form M (g) Id2p 
such that 

(M (g) ld2pYiK (g) Jp){M (g) Idzp) =k(gjp. 
Since the first term is equal to {M*-KM) ® Jp, we see that the condition becomes 

M*ifAf = k. 
By the orthogonal change of base given by 

Id2„ 



O 

we see that K becomes 



Jn 



0*K0 = K2n, 

defined in formula (120). Thus Sp^{C) is isomorphic to 0(C4",if2n). Similarly, 
is isomorphic to P2n defined in formula (121). Thus, Sp^{C)/P'^ ~ O^™ ^^^^j 
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